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Foreword 



This book is a revelation to one who has been active in the field 
of diagnosis and remediation of reading disabilities for more 
than thirty years. The contributors suggest dozens of informal steps 
of observation techniques, schemes for charting and outlining, sam 
pling recall or retelling, and other ways of analyzing children's read- 
ing. Each analytic effort is matched with appropriate remedial 
instruction steps. Even the familiar clinical or psychometric ap- 
proach is represented. No educational level is omitted in the contm- 
uum of informal diagnostic efforts. 

These approaches to understanding children's reading behav- 
iors are in effect naturalistic assessments in multiple settings. They 
are a sharp contrast to the common practice of using commercial 
tests. Teachers function as observers, recorders, providers of out- 
lines or charts, and frequently as interactants while students demon- 
strate their knowledge of text structure, pursue a think aloud 
protocol, or complete a structural or graphic organizer. In their de- 
scription of these techniques and the relevant instructional practices, 
the contributors to Reexamining Reading Diagnosis: New Trends 
and Procedures have provided a model that both teachers and 
teacher training institutions should incorporate in their efforts. 



George D. Spache 
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Preface 



The authors of this volume have contributed their knowledge to 
IRA members in two preconvention institutes that were con- 
cerned with new trends in diagnostic procedures for classrooms and 
clinics. Th- -success of those institutes was the impetus for this mon- 
ograph. We have used the strengths of each contributor to create a 
diverse, up to date text offering teachers in classrooms and clinics 
new diagnostic procedures and ideas based on current theoretical 
and pedagogical trends. 
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Reexamining Reading Diagnosis 



Why reexamine reading diagnosis? Because it is time. It is time 
because definitions of the reading process and purposes for 
instruction have changed, classroom and clinical pedagogical proce- 
dures have changed, and the population of students and our expecta- 
tions about literacy for these students have changed. We will discuss 
these issues as described in the accompanying graphic organizer. 

How Definitions of the Reading Process Have Changed 

Definitions yji reading over the past century have come fuil 
circle. We have moved from defining reading as process to defining 
it as a product and back again to a process. Current research demon- 
strates that reading involves strategies that force us to go beyond the 
printed page (Collins, Brown, & Larkin, 1980; Tierney & Pearson, 
1983). 

Explanations of the reading process reflect social, political, 
and cultural pressures. All of us who have contributed to this vol- 
ume would like to think we have created original ideas and tools to 
assess reading. Actually, we are haunted by the works of theorists of 
the past whose ideas are strikingly similar to our own. 

The story of American reading instruction, told by Nila 
Banton Smith (1965), reflects society's attempt to apply science to 
education. A look at several definitions of reading, beginning with 
Huey (1908, 1968), demonstrates this. Huey (1968, p. 1) wrote, 
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Reasons for changes Implications 



Suggestions for 
altering 
diagnostic 
procedures 





for change 



Changing Pedagogical Student 
definitions changes population 
of reading changes 



Reading, for our Anglo-Saxon forefathers, meant counsel- 
ing or advising oneself or others (A.-S. radan, to advise). 
To read was to get or to give counsel from a book» originally 
from a piece of bark on which characters were inscribed » at 
least if the reputed connection of book and beech can be sus- 
tained. The accessory notion of talking aloud seems to have 
been implied in the word, as it was also in the Roman word 
for reading. To the Roman, on the other hand» reading 
meant gathering or choosing (lectio,, reading, from lego, to 
gather) from what was written, suggesting that constant 
feeling of values which goes on in all effective reading. 

Based on our current interest in prior knowledge and predic- 
tion, we believe Huey*s interest in studies of perception and its rela- 
tionship to the reading process was insightful (Javel, 1879, Cattell, 
1886, cited in Huey, 1968). Huey was concerned with the processes 
used to gain information from the printed page. He focused particu- 
larly on the ideas represented in printed form and the means by 
which the mind takes note of them. He believed that reading was an 
activity that went beyond the eye. 

Thorndike (1917, pp. 323-332) defined reading as thinking 
and assumed that it was a process. He wrote, 

Reading is a very elaborate procedure involving a weighing 
of each of the many elements in a sentence, their organiza- 
tion in proper relations to one another, the selection of cer- 
tain of their connotations and the rejection of others, and the 
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cooperation of many forces to determine final response . . 
. . Understanding a paragraph is like solving a problem in 
mathematics. It consists in selecting the right elements of 
the situation and putting them together in the right relations, 
and also wiih the right amount of weight or influence or 
force for each. 

Huey's and Thorndike's ideas are predecessors of current 
models that describe reading as more than the interpretation of or- 
thographic symbols. Their definitions and explanations reflect the 
belief that reading requires both visual and non visual information. 
They support recent findings that prior knowledge about an experi- 
ence involving language -the syntactic, semantic, and orthographic 
elements used to create text- is stored in readers' minds, enabling 
them to predict meaning. 

Careful reading of Huey and Thorndike reveals that today's 
definitions of reading are expanded but not substantially different. 
Current scholars have elaborated on Huey's and Thomdike's notions 
to include all forms and elements of communication use^" interac- 
tively by human beings to solve problems during reading and related 
activities (Goodman, 1967; Just & Carpenter, 1987; Rumelhart, 
1985; Tiemey & Pearson, 1983; Valencia & Pearson, 1987). The 
expanded notion includes oral language (listening and speaking), 
writing, body language (kinetics), and thinking. The reader must 
use all of these effectively for successful text comprehension. Stu- 
dents also must learn more than what Yetta Goodman refers to as 
"^school reading skills." In informal conversation, Goodman has re- 
ferred to such skills as those useful to children only for proving they 
can pass reading tests. Levine (1982) concurs with Goodman and 
insists that definitions of reading be expanded so they might be con- 
sidered definitions of literacy. His notion that there are "massive dif- 
ferences between school literacy, which largely consists of academic 
exercises imposed on pupils as a curricular end in itself, and adult 
literacy, whose instrumental character naturally derives from its ca- 
pacity to serve adult needs and projects** (p. 262) must be accepted 
'or diagnostic as well as pedagogical purposes, 

We believe that definitions of reading applied to diagnostic 
procedures have been limited and confined to school reading skills. 
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We also believe that constrained measuring techniques have been 
used for so long because they are **manageable." Measuring the in- 
teractive relationships among the syntactic, semantic, and ortho- 
graphic elements of reading, writing, oral language, and body 
language presents overwhelming challenges to professionals. Devel- 
oping instructional environments for guiding students to use lan- 
guage interactively has been easier, just as it has been easier to move 
from the mastery learning of the 1960s to today's practices of match- 
ing students with appropriate methods and materials (Valencia & 
Pearson, 1987). Our goals in this text focus on changes in assess- 
ment procedures that reflect today's instructional practices. 

How Pedagogy Has Changed in Classrooms and Clinics 

Instruction in reading Hs begun to move from teacher di- 
rected to student directed activities, from moving students through 
skill development worksheets to guiding them to understanding the 
processes and strategies they need to use to comprehend text. What 
has taken place is a shift of power. In the past, teachers have as- 
sumed the responsibility for children's learning. This assumption, 
which provides teachers with the power to teach their students, as- 
sumes that teachers can teach students to learn specific concepts, 
ideas, and activities, while denying students the power to communi- 
cate. For students to become empowered, they must understand how 
they create meaning through various forms of communication. This 
ability, which focuses on knowing which strategies to use to accom- 
plish goals, provides students with the power to manipulate their 
ioeas in conventional formats for sharing. Empowered students real- 
ize that the knowledge and purpose they bring to the text is as im- 
portant as, or even more important than, the text information itself. 
These notions, supported by current research (Anderson et al., 
1976; Anderson, Spiro, & Anderson, 1977; Rumelhart, 1981), 
demonstrate that class^^oom applications that guide students to tap 
prior knowledge about content and structure of r'^ading materials 
provide a means for comprehending text effectively (Hansen & 
Pearson, 1982; Meyer, 1984). This focus has resulted in more stu- 
dent centered instruction. A comparison of the foci of traditional 
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and current notions about literacy learning as summarized by 
Glazer and Searfoss (1988) follows. 



IVaditional Notions Changes in Notions 

Emphasis is on making meaning Emphasis is on thought proc- 
from graphic symbols and on esses and language competence, 
word identification. Thought and language play in- 

teractive roles when construct- 
ing meaning from text. 

Instructional procedures go Students begin with whole 

from letter learning to words to units -stories, poems, etc. -and 

sentences. Lessons proceed move from generalizations to 

from parts and move to wholes, specifics. 
Ideas move from specifics to 
generalizations. 



Comprehension is viewed as a 
product that results from a stu- 
dent's ability to call words and 
offer expected answers to ques- 
tions and assignments. 



Comprehension is viewed as a 
process. Students use language 
cues to search their memories to 
predict outcomes. Stimuli gen- 
erate acceptable responses. Each 
student's perceptions of ideas, 
text, etc. are respected. 



Reading instruction is viewed as In reading instruction, ideas are 

strategies to guide students to more important than printed 

translate graphic symools into words, 
oral language. 



Written language is subservient 
to oral language behaviors. 



As the reader becomes skilled, 
graphic information is less im- 
portant. Clues for meaning from 
readers' perceptions take prece- 
dence. 
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How Student Pop^Mtions and Expectations Have Changed 

Student populations have increased and changed dramatically 
since the end of World War 11. Mandatory school enrollment laws 
require children from all cultures and all socioeconomic and politi- 
cal groups to attend the same schools. Children from poor and illit- 
erate homes join those from homes where the processes of education 
and reading are part of children's natural development. We in the 
United States have believed in this process of natural development 
since Jean Jacques Rousseau applied the principles of natural 
growth to French children in the eighteenth century. Rousseau s 
thoughts concurred with the American educational philosopher 
Dewey, who ?lso believed that a child's intellectual and social skills 
would develop naturally through experiences in an active environ- 
ment. 

Despite these ideas, most school curricula are prescribed. 
Educators who espouse these prescriptive curricula (beginning with 
Plato) believe that letting children grow naturally does not provide 
them with sufficient information to survive in a literate society. 

Hirsch (1987) suggests that there is an essential knowledge 
base necessary for literacy. He refers to those who possess this base 
as "cultural literates," a term Hirsch defines as coinciding with 
Chairs "world knowledge" concept. Cultural literacy consists of a 
**network of information that all competent readers possess (p. 2). 
Using this knowledge probably means scoring adequately on stand- 
ardized tests. The larger issue deals with what knowledge is neces- 
sary to be considered culturally literate both in and out of school, 
since that knowledge makes learning to read possible (Thorndike, 
1973). 

Although children learn to be literate at home, they are ex- 
pected to learn literacy skills in schools. Children from varied back- 
grounds who come to these institutions incorporate individual 
schemata from home environments that control student's expecta- 
tions, beliefs, and the responses they offer as they solve problems in 
school. Youngsters develop expectations about school behavior, 
about elements of language and how to use them, and about ways to 
solve problems. The knowledge that helps them **read" their worlds 
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in order to maintain some level of control is learned before they get 
to school. When there are problems in school and schemata for 
solving them exist in students' minds, success is likely. When sch^l 
problems arise and students' expectations and schemata for dealing 
with them are drastically different from those they've learned in 
early years, failures result. 

The Diagnostic Implications 

Our discussion seems important when reviewing most cur- 
rent assessment procedures. Testing by prescription means nrescrip- 
tive curricula. If we believe in the uniqueness of individuals, 
prescriptive curricula and tests to assess the effectiveness of these 
curricula seem inappropriate. 

Our populations and expectations for students and teachers 
have changed, and our definitions of literacy processes have ex- 
panded. Our pedagogy has expanded to reflect current research 
about learning literacy skills. Our tests and testing environments, 
however, have changed little. The testing mentality of our society 
perpetuates itself and remains rigid. Hirsch's notion is timely, since 
the public seems to want to hear that there is a body of knowledge 
that creates literate students. We wish that were so; then we would 
have literate students who could employ literacy skills for success 
both in school and out. When diagnosing students' abilities, we 
would be able to follow traditional notions about learning to read. 
Diagnostic procedures could determine "levels of knowleldge" for 
grade placement. If students were found to have deficits, we could 
label them (learning disabled, dyslexic) and place them in special 
classes. Actions taken as a result of this one test session (or score) 
criterion could be prescriptive and definitive, since the assessment 
procedures were conducted by prescription. 

Although we have learned that prior knowledge and the abil- 
ity to predict what is in reading materials greatly influence compre- 
hension, tests do not consider these elements. Tests provide few 
occasions for students to use their perceptions of ideas to cieate or 
choose questions about what they read. We know of no standardized 
testing tool that assesses the strategies students use for learning. 
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There are lew instruments that use complete stories, poems, or con- 
tent passages. 

As we have considered current expectations, we marvel at 
hew well students have responded, considering the impediments un- 
der which they are expected to function. The environments in which 
students take tests are appalling. They seldom resemble the instruc- 
tional setting in which students learn to read: 

//ow We Can Create Better Assessment Situations 

Assessment procedures and their purposes must be redirected 
to assess students' strengths instead of deficits. This idea is not new. 
Students shoul(^ be observed in activities where successful text com- 
prehension occurs. This requires expanding the places where we as- 
sess students. The diagnostic process must include observing 
students interac '^g with effective teaching methods and learning 
materials. Such diagnostic procedures require continuous o*^ -erva- 
tion over time in many settin . This naturalistic approach to assess- 
ment views the learner during the learning process, recognizing the 
social, political, and cultural diversities among students. It demands 
that students learn from one another and teachers learn from stu- 
dents; it demands that environments include humor, since learning 
is often tedious, difficult, and frustrating. 

Learning to observe reading behaviors in varied settings de- 
mands concentration and trial and error. The activities involved 
might be compared to reading a complicated passage of text. You 
must encode the conrplicated text by reconstructing meanings for 
yourself. In order to construct meanings about student behavior, you 
must learn how to observe students* approaches to constructing 
meaning, which requires an element of expertise unnecessary in tra- 
ditional testing. The observer must note growth and changes, then 
record the data and interpret its meanings. Astute watchers develop 
questions as they observe students in reading, writing, listening, and 
other language behaviors. After a period of observation, appropri- 
ate pedagogical goals might be developed, based on tentative con- 
clusions considering each student's strengths and needs. 

Researchers and theorists (Johnston^ 1987; Paratore & Indri- 
sano, 1987) are developing realistic models of assessment. Our 
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model, c-A-L-M (a suitable anachronism for the teacher/researcher 
who diagnoses in classrooms and clinics), represents one way of de- 
scribing a naturalistic approach to assessment. It eliminates the no- 
tion of one testing session, thus eliminating stress, since there are 
many chances to observe the performance of students and teachers. 
The Cumulative /!ssessment of Language Model (Glazer & Sear- 
foss, 1988) in the Figure provides one framework for using multiple 
tools, multiple environments, multiple strategies, and multiple set- 
tings for collecting data on which to base descriptions of students' 
performances in reading. 



Continuous /Issessment of Language 
Model: calm 




From Susan Mandel Glazer and Lyndon W Searfoss Reading diagnosis and insinuiian A 
L ALM approach Englpwood Cliffs. NJ Prentice-Hall. 1988 Used with permission 
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The model also demands that teachers evaluate themselves 
during the assessment process by asking themselves the following 
questions. 

1. Am I observing students reading in 

recreational settings? 
instructional settings? 
interactive settings? 
individual (tutorial) settings? 
formal test taking settings? 

2. Have I collected sufficient data about the students as they 
interact with text materials in these settings to make appro- 
priate pedagogical changes? 

3. Have I collected the data considering my question about 
the behavior? 

4. Was my question appropriate? What do I observe (ask) 
next? 

Summary 

Realistic evaluation means evaluating students and ourselves. 
Self-evaluation encourages students to continually look at them- 
selve . Repeatedly asking questions about self, our instructional ef- 
fectiveness, and our abilities to change helps us serve as models for 
students doing the same. Evaluation, in the global sense, demands 
that we review how we think about ideas to create and respond to 
various tests. Once we know the "how" about our learning, we can 
make effective changes in ourselves and in our teaching procedures, 
thus positively affecting students' literate lives. 
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MeiTia M. McMillan 



Reexamining the Role of Emotional 
Maladjustment* 



The purposes and goals of this chapter are fourfold: (1) To 
present research findings related to emotional maladjustment 
and reading, (2) to consider stress as a significant factor in emo- 
tional maladjustment to reading, (3) to provide an instrument that 
may assist in identifying specific stress reactions to reading, and (4) 
to suggest effective approaches for working with students whose 
maladjustment to reading may be either the source or result of their 
emotional difficulties. 

The accompanying graphic organizer provides the structure 
for this chapter. 

Research 

Many studies suggest students with reading diificulties dem- 
onstrate behavior associated with emotional maladjustment at 
home, at school, or both (Dolch, 1931, 1951; Robinson, 1946, 
1964; Spache, 1976). Moreover, the literature points to a strong 
connection between stress and i ading difficulties (Gentile, 
McMillan, & Swam, 1985). These studies also indicate that when 
students expe^'ience emotional trauma during reading, they often are 
unwilling , ^nable to concentrate (Allington, 1980; Blanchard, 
1936; Gann, 1945; Gates, 1941; Natchez, 1959). Under these cir- 
cumstances, reading may evoke specific maladaptive stress reac- 
tions that inhibit students' learning .Cannon, 1915; Selye, 1956, 

♦Adapted from Lance M Gentile and Merna M McMillan. Stress and reading difficulties 
Heminh, msLSsment, mtencntum Newark, DE International Reading Association. 1987. 
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1976; Weinberg & Rehmel, 1983). These reactions have beer, found 
to be both physical and psychological and are manifested in a range 
of behavior rrom anger and aggression [fight] to avoidance and ap- 
prehension [flight] (Bird, 1927; Dreikurs, 1954, 1964; Freud, 
1935; Wiskell, 1948). Finally, some studies and theories show that 
overtly or covertly, parents, teachers, or peers may contribute to 
making reading threatening or stressful (Deci, 1985; McDermott, 
1977; Silverman, Fite, & Mosher, 1959). 

Assessment 

To date, most efforts to measure and remediate reading diffi- 
culties an based on standardized or informal skills tests. Underly- 
ing these tests is the notion that if teachers can identify specific 
skills deficits, they will be able to find an instructional cure to re- 
lieve the symptoms of reading difficulty. This reductionist view of 
reading may contribute to the fact that research fails to show many 
long term gains or lasting effects of remedial reading instruction. 
Johnston (1985, pp. 174-175) noted, 

Past attempts at explanations of the differences between 
good and poor readers have tended to dwell on the minutiae 
of mental operations without considenng either the psycho- 
logical or social contexts in which they occur .... Most 
current explanations of reading difficulties focus on the 
level of operations, devoid of context, gor^ls, motives or his- 
tory. While some work has focused on the context of read- 
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ing failure rather than mental operations (McDermott, 
1977; Mehan, 1979)» there has been little effon to integrate 
these two dimensions. The consequent explanations of read- 
ing failure are sterile and have resulted in more or less ter- 
minal diagnoses of reading failure. Until we can integrate 
the depth of human feeling and thinking into our under- 
standing of reading difficulties^ we will have only a shadow 
of an explanation of the problem and ill-directed attempts at 
solutions. 

One reason most remedial reading programs focus only on 
skills deficits is that school administrators and state legislators use 
only the results of standardized reading skills tests for determining 
good and poor readers, comparing schools, and judging teacher ef- 
fectiveness. While these tests may be a useful measure for compar- 
ing students within or among groups, they should not be used as the 
sole basis for designing remediation in reading. According to Mof- 
feu (1985, p. 52), "If it*s not tested, it's not taught." 

Assessment and intervenrion must go beyond skills deficits 
and consider the following points: 

• It is as important to understand, measure, and address the 
social and emotional variables that form the core of many 
students* struggles or failures in reading as it is to test and 
evaluate their basic reading skills deficits. Relying solely 
on skills deficits to identify students* difficulties in reading 
is inadequate for helping ihem learn to read and make a 
better adjustment to reading. 

• The whole of reading is greater than the sum of the parts. 
Undeniably, skills are important in reading, as is time on 
task skills practice, but social and emotional adjustments 
determine how little or how much a student brings to and 
derives from reading and reading instruction (Dreikurs, 
1954; Gentile & McMillan, 1981). 

• Many students with reading difficulties can demonstrate 
some level of skills mastery compared with other students 
of the same age or grade level (Lamb, 1985), but standard- 
ized test results fail to show what students are capable of 
doing. In most cases, skills test results reveal the approxi- 
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mate level at which a student^s growth in reading stops. 
Missing from these test results are two important pieces of 
information relevant to helping students learn to cope ef- 
fectively with reading difficulty: How hard did students 
try? What coping skills did they demonstrate when the test 
became difficult? (Gentile, McMillan, & Swain, 1985), 
Students' perceptions of their testing and reading capabilities 
affect what ihey choose to do, how much effort they mobilize, how 
long they persevere in the face of difficrlties, their thought patterns, 
and the amount of stre';s they experience in taxing situations. 

Successful readers respond flexibly to the emotional chal- 
lenges of tests and reading assignments. They perceive reading as 
challenging not threatening; they anticipate positive results for their 
efforts. Consequently, they have developed reading skills and study 
habits that p)eTmit them to work effectively, to assume responsibility 
for their own learning, to be comfortable and relaxed while reading, 
and to resolve their own difficulties. 

In general, most successful readers are accepted by their 
peers. They are supported and encouraged by parents and teachers 
who expect them to succeed. Usually they are friendly, polite, and 
cooperative. They read independently, concentrate, and complete 
assignments satisfactorily and on time, While they may experience 
some difficulty or make mistakes in reading, they cope effectively 
and show steady improvement, They have learned to overcome 
problems through diligence; patience; and focused, consistent ef- 
fort. They recognize their limitations yet work to strengthen their 
reading. 

However, poor readers face many problems in addition to 
their skills deficits. Silverman, Fite, and Mosher (1959, p. 299) 
said, "Considering reading difficulties as a symptom, if all efforts 
then are aimed at curing the specific symptom, we might expect 
tiiese efforts to be of no more avail than painting away the spots to 
cure the measles Of greater significance are students* reactions to 
reading when it is stressful for them because these responses have 
the capacity to dictate and disrupt a!! future experience with written 
matter (Laurita, 1985). 
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Poor readers perceive reading as a threat and frequently ex- 
hibit maladaptive stress reactions when they read. Poor readers also 
display self-deprecation, lack of a clear system of goals or values, 
vulnerability to disparagment by others, immature relationships 
with parents or teachers, lack of insight into personal problems, or a 
pervasive depression (Maxwell, 1971). 

Other researchers have provided detailed descriptions of stu- 
dents' maladaptive stress reactions "to reading. Gentile and 
McMillan (1984) and Swain (1985) analyzed the records of 5(X) stu- 
dents with reading difficulties referred to an interdisciplinary, diag- 
nostic, and remedial center over a seven year period. All the 
students were given a full multidisciplinary assessment; none was 
diagnosed as having neurological, psychological, or other physical 
in^pairmeiits that would alter the expectation of normal development 
in reading. Data were drawn from referral and evaluation statements 
of parents, teachers, reading specialists, and counselors; observa- 
tional information recorded during the administration of formal and 
informal tests; and statements gleaned from diagnostic or prescrip- 
tive reports. The descriptions were consolidated and classified. 
What emerged was a spectrum of fight or flight behavioral catego- 
ries ranging from hostility and rage to immobilization and retreat. 

From these studies Gentile and McMillan (1984) developed 
the Stress Reaction Scale for Reading. This scale can be used to 
identify students' maladaptive, fight or flight stress reactions to 
reading and to guide the use of appropriate instructional techniques. 
The instrument is designed to provide an overall impression of stu- 
dents' reactions to reading. Because of the complexity of reading 
problems, these emotional reactions are difficult to categorize pre- 
cisely. Rather, the Scale is intended to show behavior trends when 
reading is stressful. The scale is not all inclusive and should be used 
only as an observational tool. 

Stress Reaction Scale for Reading 

For each of the following phrases, circle the letter, a or b, 
that most accurately describes the student's reactions when asked to 
read or during reading. If neither one applies write N/0 on the blank 
to the right of each pair. 
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When asked to read or during reading, this student: 

1 . a. exhibits overt hostility or rage. 

b. becomes anxious or apprehensive. 

2. a. becomes sullen or exhibits aggressive, acting out 

behavior. 

b. appears indifferent, insecure, or fearful. 

3. a. responds impulsively to requests or questions, blurts 

out answers and offers information that is irrelevant 
or inaccurate, 
b. appears subdued, overly withdrawn, and depressed. 

4. a. throws temper tantrums, cries, or becomes verbally 

abusive. 

b. seeks an escape or runs and hides. 

5. a. clenches fists, becomes rigid, defiant, and angry. 

b. appears despv..ident, passive, and unable to 
concentrate. 

6. a. becomes defensive and resistive, verbalizes or 

expresses an attitude of "I don't want to.'' 
b. lacks confidence, appears timid, verbalizes or 
expresses an attitude of "I can't, it's too hard." 

7. a. demands entertaining, easy, or expedient activities, 

shows no tolerance for difficulty or challenge, 
b. takes no risks in challenging situations, constantly 
answers, "I don't know," even when answers are ob- 
vious. 

8. a. refuses to comply, does not follow directions or 

complete assignments, 
b. appears embarrassed, daydreams, or frets over lack 
of ability. 

9. a. becomes upset with change in routir^ .w^ 

the situation to satisfy personal eds Hims. 
b. requires constant assurance, fre4uently Ci ^cks with 
teacher by asking, "Did I get that right?" or "Was 
that good?" 
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10. a. seeks to disrupt the teacher, the lesson, or other 

students. 

b. expresses fear of rejection by parents, teachers, or 

peers for reading weaknesses. 

11. a. uses any excuse for not being able to participate, 

temporizes until pardr* or teacher gives up. 
b. skips over materia!, ignores punctuation, inserts or 
deletes words and phrases, unable to follow struc- 
ture or order. 

12. a. demands constant supervision, attention, or guid- 

ance, refuses to do any independent reading, 
b. will try as long as parent or teacher closely monitors 
situation, appears helpless when left to work inde- 
pendently. 

13. a. provides sarcastic, bizarre, or nonsensical answers 

to teachers' questions; makes weird sounds; sings; 
or bursts into loud, raucous laughter, 
b. becomes excessively self-critical, says things like, 
"I'm dumb," **I never get anything right," or "I'm not 
a good reader." 

14. a. declares reading is "boring," "no fun," "hard work," 

refuses to cooperate, 
b. tries too hard, is immobolized by perceived failure. 

15. a. makes little or no effort to succeed; shows disdain 

for activities; voices anger or displeasure at parents, 
teachers, and students who offer assistance, 
b. verbalizes or expresses an attitude of apathy, shows 

no willingness to try. 

Interpreting the F^ress Reaction Scale for Reading 

To determine the fight reactions, count and record the num- 
ber of fl's circled., For the flight reactions, count the number of 6's. 
Typically, one pattern will dominate. It is not unusual for a student 
to have some a's and some b*s circled or to have some N/O's re- 
corded. A combination of interventional methods and materials is 
needed where a pattern is not consistent. 
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Remediation 

When reading is stressful, students often try to avoid or es- 
cape the source of their discomfort. Fight or flight reactions tend to 
reinforce themselves because they reduce stress or anxiety. 'Hiere- 
fore, such reactions are difficult to change. 

After a student's pattern of responses to reading is deter- 
mined, the next step is to plan appropriate intervention and to direct 
the role played by the teacher in remediation. When working with 
students v/ho demonstrate a fight or flight response, the teacher 
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must understand the types of interactions that may take place be- 
tween student and teacher. The Figure illustrates this principle. 

The adaptive reaction shows an integrated relationship be- 
tween the teacher and student around reading. The fight reaction 
shows the student avoiding reading by confronting the teacher and 
leaving the assignment behind. The flight reaction shows the student 
escaping from reading and the teacher. For the student who demon- 
strates a fight reaction, a strategy must be designed to move the stu- 
dent away from the confrontation or "fight" with the teacher and 
back to the reading assignment. This requires a concise and consist- 
ent approach with a minimum of verbal interaction and prompting. 

When the student flees the stressful tasks of reading, the 
teacher must focus on drawing the student out and toward the task 
and the teacher. This requires direct intervention, prompting, and 
talking. This basic difference in approach must be considered in ap- 
plying discipline, establishing goals and incentives, and teaching 
self-regulatory skills to these students (Gentile & McMillan, 1987). 

Attempts to remediate students' reading difficulties must not 
only include skills development but also emphasize acquiring the 
appropriate behavior to overcome reading difficulties and belief in 
their ability to master these problems. There is a difference between 
possessing reading skills and being able to apply or use them under 
challenging, difficult, or stressful circumstances. These situations 
require students with reading difficulties to develop self-regulatory 
skills in order to cope. In the absence of these skills, most resort to 
self-defeating stress-reducing behavior to expunge the threat read- 
ing poses to them, whether it be loss of self-esteem, frustration, or 
fear of ridicule. 

Students with reading difficulties must learn to deal directly 
with the stress they experience during reading by reappraising the 
threat and developing positive ways of coping with it. These stress 
reducing methods, called direct or self-regulating coping skills 
(Hilgard, Atkinson, & Atkinson, 1975), must be taught as diligently 
as functional reading skills because they help students master their 
reading difficulties and produce long term, positive effects during 
reading instruction. 
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The two main features of teaching direct coping methods to 
students with reading difficulties are the interventional approach 
and the role of the teacher. 

The Intervention Approach 

Remedial reading programs are bolstered when students are 
taught three major coping or self-regulatory skills: goal setting, 
self-incentives, and self-monitoring (Bandura, 1977; Kanfer, 1980; 
Runck, 1982). 

Goal Setting, White (1959) posited that humans have a basic, 
lifelong drive for ordering and mastering the environment. This 
drive is so strong that when order does not exist, a person will tend 
to impose order on external phenomena (the parallel for internal 
phenomena would be self-consistency). Ordering the environment 
reduces the uncertainty about what to expect, giving the individual 
better powers of prediction and control and, hence, reinforcing feel- 
ings of security by reducing the anxiety associated with uncertainty.. 

Teachers can help students regulate their reading difficulties 
by establishing explicit, reasonable, and reachable goals. Getting 
students to make self-directed changes in their reading requires the 
development of standards and goals to motivate and guide them. 
Bandura (1985, p. 9) described this process: 

When people commit themselves to explicit gcals, negative 
discrepancies between what they do and what they seek to 
achieve serve as motivators for change. By making self-sat- 
isfaction contingent on goal attainment, people persist in 
their efforts until their attainments match what they are 
seeking to achieve. 

The purpose of many reading assignments may be unclear 
and meaningless to students with reading difficulties. These stu- 
dents do not understand that what they are doing will help them be- 
come better readers and improve their chances of succeeding in 
school. Reading assignments seem unrelated to their goals and pro- 
vide no assistance in overcoming their educational or personal prob- 
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lems. In fact, these assignments may only highlight perceived 
incompetencies. Teachers can aid students with reading difficulties 
by helping them establish explicit goals and by providing penorm- 
ance feedback. 

Whether students with reading difficulties are motivrited or 
discouraged when they fail to attain goals they have set for tnemsel- 
ves is ultimately determined by their perceptions of their ca* oity to 
attain the goal. According to Bandura (1985, p. 10), "Those who 
doubt their capabilities are easily discouraged by failure, whereas 
those who are highly assured of their efficacy for goal attainment 
intensify tlieir efforts when their attainments fell short, and perse- 
vere until they succeed.** 

Research has shown goal setting along with performance 
feedback to be highly effective in developing self-motivation (Lx>cke 
et al., 1981). The degree to which establishing goals is an incentive 
for self-directed change in reading is dependent on three things: 

1. The explicitness of the goals. Explicit goals provide clear 
guides for action as well as the means for students and 
teachers to evaluate performance. General goals are too 
vague and fail to direct students' motiva**^-^ '^nd behavior 
in reading instruction. 

2. The level of the goals. Setting reasonable goals, working 
through incremental instructional steps, and making con- 
structive appraisals of achievement sustain students' moti- 
vation and self-directed changes in reading. Students who 
set unrealisticalh/ high goals for improving their reading 
are disappointed when they fail to fulfill them. 

3. The proximity of goals. The effectiveness of goals is 
largely determined by how far into the future they are pro- 
jected. Proximal goals mobilize effort and direct what one 
does now. When the student focuses on the distant future, 
it is too easy to temporize efforts at change in the present. 
"One can always begin in earnest in the tomorrows of each 
day" (Bandura, 1985, pp. lO-U). Students with reading 
difficulties must establish short term goals they can ac- 
complish realistically. These subgoals can be the basis for 
greater achievement in the future. They also pro/ide con- 




Gentile and McMillan 

SI 



tinuous incentives and guides for self-regulation that build 
a sense of competence, self-satisfaction, and motivation. If 
students concentrate on improving their reading each day 
in class, in a year's time they will be well on the road to 
attaining their long term goals. 
Self-Incentives. The second step in developing students* direct 
coping or self-regulating reading skills is to help them establish in- 
centives to work and to provide themselves with tangible rewards 
when they reach established goals. Bandura (1985, p. 1 1) adds: 

People can get themselves to do things they would other- 
wise put off or avoid altogether by arranging incentives for 
subgoal attainments. They achieve greater self-directed 
change if they reward their successful efforts than if they 
provide no incentives for themselves. Evaluative self-incen- 
tives also serve as important self-motivators and guides for 
behavior. People get themselves to put forth the effort nec- 
essary to accomplish what they value for the satisfaction 
they derive from fulfilling goals they set for themselves. 

Students* incentives are highly individual. It is important that 
teachers take the time to define each student's incentives. While 
some incentives can be used effectively for groups of students, the 
most powerful and sustaining are those identified by students them- 
selves. Ultimately, there is a big difference between developing an 
inner desire to be an effective reader and being extrinsically moti- 
vated to read by rewards or punishments from teachers, parents, or 
peers. 

Self-Monitoring. As a final step in helping students acquire 
coping or self-regulatory skills, teachers must help them monitor 
the behavior they seek to change (Ka/din, 1974). Encouraging stu- 
dents to keep track of their stress level and the events that foster it 
during reading serves several purposes. According to Bandura 
(1985, p. 9), "Observing covariations of behavior and the circum- 
stances under which it occurs serves as a self-diagnostic device for 
identifying determinants of one's behavior. Self-monitoring also 
provides the information needed for setting renlistic subgoals and 
for evaluating one's progress. Continuing feedback about how one is 
doing is essential in sustaining the process of change." 
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Sports provides a model for demonstrating the importance of 
self-monitoring. A weight lifter, for example, can record the in- 
creasing number of presses or curls and can see increased muscle 
structure. This positive feedback encourages continued effort and 
improvement (Horn, 1986). Teachers need to set up the same kind 
of circumstances for students during reading instruction. 

Teachers or students can observe incremental gains in read- 
ing and provide feedback. To ensure long term effects, students with 
reading difficulties must have reasons to change and the means to do 
so. Neither goals without performance feedback nor performance 
feedback without goals achieves any lasting change (Bandura & 
Cervone, 1984). 

Before positive changes can occur, students must recognize 
their problems, acknowledge the nature of those problems, and gain 
control using adaptive stress reducing behaviors. This means sizing 
up the situation accurately and attempting to solve problems. 

Entwisle (1971) suggested that "control beliefs" are espe- 
cially important in reading because middleclass parents teach their 
children to expect order and meaning in their daily lives and to de- 
velop alternative strategies for dealing with problems that appear to 
violate this order. Other children's early education may be deficient 
in these respects.. When children expect reading to be a system with 
its own internal meaning and consistency as well as a tool to help 
solve other problems, they are often excited about learning to read. 
If children do not see reading as having these characteristics, it be- 
comes "one more tl ng" imposed on unwilling victims by powerful 
authority figures. 

The Teacher's Role 

The teacher's role is crucial in creating an instructional envi- 
ronment that leads students to success, by modeling and by assisting 
students in developing attainable goals, providing consistent feed- 
back, and eliciting self-evaluative information concerning reading 
performance. A structured, purposeful approach is vital to the proc- 
ess of self-regulation and remediation in reading. 

Students with reading difficulties must learn to apply self- 
regulating skills steadily and consistently in attempting increasingly 
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challenging and sometimes stressful assignments. Teachers must 
help students gain confidence in attempting more difficult reading 



Immediate success is essential for students who have a his- 
tory of difficulty or failure in reading. However, thes: students must 
gradually learn to struggle with adversity and to overcome their 
problems, even if they do encounter occasional failure. 

Eventually students learn that their difficulty or failure in 
reading may be more attributable to a lack of effort than to a lack of 
ability or to external factors. Research on learned helplessness indi- 
cates that, with few exceptions, more reading difficulties result from 
students' lack of effort than from their lack of ability. 

Teachers must work so these students 

1. Gain control over their reading responses. Students need 
to identify their maladaptive stress reactions to reading 
and develop more successful strategies that help them ap- 
proach and gain control. Only then can they experience 
success as readers. 

2. Gain confidence and competence as readers. Students 
need to be shown how to apply the necessary skills to suc- 
cessfully complete reading assignments. This means more 
than mastering isolated skills; it means developing the nec- 
essary self-control and strategies to study and process 
written information for purposes of taking tests, making 
oral and written reports, and contributing to class discus- 
sions. 

3. Gain closure and learn to cope successfiilly with their 
reading difficulties through self-regulation. This includes 
helping students overcome their fear or anger toward read- 
ing by identifying and reinforcing purposeful reading ac- 
tivities, mastering incremental learning steps, and 
establishing a schedule for accomplishing the work. Stu- 
dents cannot alter what has happened to them in the past, 
but they can pursue solutions to current problems through 
prediction, flexibility, concentration, careful preparation, 
and practice. 



tasks. 
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Typically, students with reading difficulties develop a percep- 
tion of reading and of themselves as readers that is geared to failure. 
They expect to do poorly and to fail; consequently, they do both. 
Their apprehension makes them anxious enough to force these out- 
comes, Teachers are like good coaches, They must push students to 
do their best, sometimes beyond their abilities; help them overcome 
the fear of failure so they will take l i^ks; and provide safety nets to 
catch them when they stumble. Teachers must also develop special 
relationships with these students, providing patience, understand- 
ing, and knowledge to help students achieve specific goals. 

Summary 

McGuiness (1986) said, "It is time t.hat the research on learn- 
ing to read and on acquiring self-control be brought into the main- 
stream and taught in teachers' colleges,'* Teachers working to help 
students overcome reading difficulties need to teach self-regulating 
skills as well as skills needed to decode and interpret print. Effective 
intervention can provide the basis for students to reach reading inde- 
pendence through self-correction and guidance. Students must be 
taught to set explicit, proximal, and reasonable goals; arrange re- 
wards for their efforts; monitor thei*" self-defeating fight or flight 
responses when reading is stressful for them; and use a variety of 
coping strategies instead of a single technique. 
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A Dynamic-Developmental-Interaction 
Approach to Reading and Related 
Learning Disabilities 



While most of this monograph is addressed to the issue of diag- 
nostic procedures suitable in the assessment of reading prob- 
lems, this chapter will focus on individuals who experience reading 
and related learning disabilities. To this end, I will define learning 
disabilities and show how Ihey are differentiated from most learning 
problems. The term "learning disabilities" suggests the presence of 
some form of central nervous system dysfunction; reading disability 
is one type of learning disability. For individuals experiencing read- 
ing and lelated learning disabilities, a medical model in diagnostic 
assessment is most efficient. A m'lltidisciplinary orientation is es- 
sential, along with a developmental approach in which the individ- 
ual is evaluated and diagnosed in terms of the dynamic interaction of 
physical, cognitive, educational, social, and affective fatioib. 

The graphic organizer gives some structure to this chapter. 

The Problem of Definition 

There is confusion concerning learning disability because of 
multiple and varying definitions. Historically, the term "learning 
disability" was first used by Kirk (1962), who stated that a learning 
disability refers to a retardation disorder, or delayed development m 
one or more of the processes of speech, language, hearing, spelling, 
writing, or arithmetic. Kirk indicated further that the disability re- 
sulted from possible cerebral dysfunction or emotional or behav- 
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ioral disturbance. He excluded disabilities stemming from mental 
retardation, sensory deprivation, or cultural and instructional fac- 
tors. Bateman (1965) described children with learning disabilities as 
those who manifest an educationally significant discrepancy be- 
tween their estimated intellectual potential and actual level of per- 
formance. She related the disability to some basic disorder in the 
learning processes, which may be accompanied by demonstrable 
central nervous system dysfunction. She excluded those disabilities 
secondary to generalized mental retardation, educational or cultural 
deprivation, severe emotional disturbance, or sensory loss. 

In 1968, the National Advisory Committee on Handicapped 
Children stated that learning disabilities may be manifested in disor- 
ders of listening, thinking, talking, reading, writing, spelling, or 
arithmetic. Learning disabilitie.<i include conditions referred to as 
perceptual handicaps, brain injury, irimimal brain dysfunction, dys- 
lexia, and developmental aphasia. They do not include learning 
problems due primarily to visual, hearing, or motor handicaps; to 
mental retardation or emotional disturbance; or to environmental 
disadvantage. This view of learning disabilities essentially consti- 
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tutes the definition Congress used in Public Law 94-142: The Edu- 
cation for All Handicapped Children Act of 1975. This is the 
definition most widely used to identify pupils eligible for specific 
learning disability services. Numerous positive effects have been re- 
alized through the definition and general goals of PL 94-142. How- 
ever, misinterpret: ions of the definition have resulted in a series of 
problems that have affected theoretical and service delivery issues in 
learning disabilities. 

The National Joint Committee on Learning Disabilities 
(njcld) has commented (1981) on problems raised by the misinter- 
pretations of the definition staled in PL 94-142. The njcld empha- 
sizes that learning disability should be recognized as a general term 
referring to a heterogeneous group of disorders involving different 
subgroups of individuals. One must recognize the developmental nat- 
ure of learning disabilities and view them as problems from early 
childhood into adult life. The njcld urges that disorders represented 
by the term learning disabilities'" be understood as intrinsic to the 
individual and that the basis of the disorders be presumed to be some 
form of cen'ral nervous system dysfunction. While the njcld sup- 
ports the idea that failure to learn or to attain curricular expectations 
occurs for diverse reasons, learning disabilities have their basis in 
inherently altered processes of acquiring and using information. Fi- 
nally, the NJCLD points out that the wording of the exclusion clause in 
the current definition of learning disabilities lends itself to the misin- 
terpretation that individuals with learning disabilities cannot be multi- 
handicapped or be from different cultural and linguistic backgrounds. 
Learning disabilities may occur concomitantly with other handicap- 
ping conditions. 

In light of the points stated previously, the njcld (1981, p. 5) 
recommends the following definition of learning disabilities: 

Learning disabilities is a generic term that refers to a heter- 
ogeneous group of disorders manifested by significant diffi- 
culties in the acquisition and use of listening, speaking, 
reading, writing, reasoning or mathematical abilities. These 
disorders are intrinsic to the Individual and presumed to be 
due to central nervous ystem dysfunction. 
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Even though a learning disability may occur concom- 
itantly with other handicapping conditions (e.g., sensory 
impairment, mental retardation, social and emotional dis- 
turbance) or environmental influences (e.g., cultural differ- 
ences, insufficient/inappropriate instruction, psychogenic 
factors), it is not the direct result of those conditions or in- 
fluences. 

The confusion regarding the definitioH of learning disability 
has resulted in wide variance in agreement of the incidence of the 
learning disabled. Figures on the incidence of learning disabilities 
within public schools range from 3 percent to 20 percent depending 
on the definition and types of factors used in deriving the figures. 
When learning disability is defined as in the statement of the njcld, 
the incidence is probably close to 3 percent. In counting children, 
Congress has stated that children with specific learning disabilities 
may not constitute more than one-sixth of the children counted as 
handicapped.^ Another limitation is that a state may not count as 
handicapped more than 12 percent of children aged five through 
seventeen. This means that for allocation purposes only 2 percent of 
the children in a slate may be counted as having specific learning 
disabilities. 

In summary, the following are some of the major points re- 
garding the problem of definition: 

1. The vast majority of children who are experiencing aca- 
demic difficulty in school have learning problems, not 
learning disabilities. (See Gentile and McMillan, this 
volume.) 

2. Most reading and related learning problems are caused 
by external factors; by largely environmental aspects. 
The most common causes are in the educational sphere: 
inappropriate teaching, nondifferentiated instruction, and 
overcrowded classrooms. Most of this monograph is in- 
tentionally addressed to the assessment procedures used 
in the diagnoses of reading/writing problems. 

3. Some reading/learning problems may be the result of 
other environmental factors such as cultural deprivation 
or emotional blocking. 
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4. Learning disabilities are intrinsic to the individual and 
are presumed to be the result of some form of central ner- 
vous system dysfunction. 

5. Learning disabilities are neither common nor rare. The 
incidence in the general school population is probably 2 
percent to 5 percent. 

6. Learning disabilities do not represent a homogeneous 
group of individuals. Rather, the term is a general one 
referring to a heterogeneous group of disorders realized 
as significant difficulties in the acquisition and use of one 
or more of the following functions: listening, speaking, 
reading, writing, reasoning, and mathematical abilities. 

7. Reading disability is one type of learning disability. The 
incidence of reading disability in the general population 
is probably no more than 2 percent. 

8. Reading and related learning disabilities can occur in 
early childhood, during the school years, and in adult 
life. The learning disability may be maniferted in differ- 
ent ways at varying stages. 

9. Sensory impairment and emotional difficulties may occur 
concomitantly with learning disabilities, but they are not 
the primary cause of the problem. 

10. While all individuals should be provided appropriate edu- 
cational services, one must ne'.ther deny the existence of 
nor overestimate the incidence of reading/learning 
disabilities. 

Diagnostic Considerations 

Among learning disability professionals, there is an increas- 
ing awareness of the need to move away from fragmentation and 
toward a more comprehensive and less divisive approach in the di- 
agnosis of reading and related learning disabilities. This awareness 
stems partially from the realization that understanding deviant func- 
tions of learning disabled children comes from having a coherent 
theoretical framework that directs systematic investigations and in- 
tegrates the data meaningfully (Senf, 1972). The efficacy of treat- 
ment and the prognosis Jcpend on the validity of the diagnosis. 
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This, in turn, is contingent upon the accuracy of one s observations, 
the availability of a conceptual framework that permits the synthesis 
of those observations into a meaningful pattern, and the integration 
of that pattern into existing knowledge. Without objective observa- 
tions and an appropriate conceptual framework, a valid diagnosis is 
not possible. 

In using a dynamic-developmental-interaction approach to 
the diagnosis of learning disabilities, close attention must be given 
to the interaction, assimilation, accommodation, and integration of 
biological, psychological, social, economic, and educational fac- 
tors. The individual is viewed as a physical organism functioning in 
a social environment in a psychological manner (Abrams, 1984). 

It must be reemphasized that the population of learning dis- 
abled individuals addressed in this chapter are most frequently as- 
sessed in a one to one, clinical situation (such as a reading clinic, 
child guidance clinic, hospital). We assert that schools, in general, 
are responsible for recognizing and accommodating the wide varia- 
tions of normal individual differences in learning. In the usual 
course of development there arc also differences and delays that can 
interfere with the expected acquisition and use of academic skills. 
Students who show such variations should not immediately be 
thought of as having learning disabilities and referred for special 
help. In most cases, their needs should be addressed within regular 
education. One pu pose of the assessment procedures is to make a 
differential diagnosis. That i ^, it is necessary to rule out conditions 
other than learning disabilities that may interfere with the individ- 
ual's ability to function effectively in school. As stressed previously, 
a major objective of this type of diagnosis is to differentiate a learn- 
ing problem from a learning disability. 

The dynamic-developmental-interaction orientation in the di- 
agnosis of learning disability requires a multidisciplinary approach. 
No one professional has the skills and knowledge necessary to eval- 
uate, diagnose, recommend, or provide programs and services for 
the individual who is identified as having a learning disability. The 
major purposes of any diagnostic evaluation are to determine the 
existence and severity of the learning disability, the specific 
strengths and weaknesses, and the therapeutic steps needed to ame- 
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liorate the condition. For diagnosis to be effectwe, it must also 
result in accurate communication to the remedial clinician, the ther- 
apist, the school, and the parent of sufficient information about the 
problem so that a profitable program of habilitation or rehabilitation 
will result. If the only resultant in a thorough diagnostic procedure 
is an explanation of the difficulty, the process has been next to use- 
less. For the child, the home, and the school, the problem is st*li one 
of finding a solution to the inadequate forms of adjustment that were 
the precipitating reasons for the referral in the first place. 

In order to comprehend fully all of the factors contributing to 
the individual's reading or related learning disability, information 
must be obtained in five major areas. First, a detailed history is re- 
quired to provide the contextual basis for understanding and inter- 
preting all the clinical and test data obtained. Emphasis is on 
maturation and development with attention focused on the numerous 
biological and environmental factors that influence the child's physi- 
cal, social, and cognitive growth. Second, there should be careful 
analysis of the individual's current physical, social, and emotional 
status. Third, an individually obtained assessment of the child's in- 
telligence is required. One must keep in mind, however, that th^ in- 
telligence quotient is not the sole measure of cognitive poility. 
Criteria based on IQ scores typically disregard intraindivldual dif- 
ferences in performaiice with respect to different aspects of intellec- 
tual functioning. In addition, manifestations of learning disabilities 
can reduce performance on intelligence tests as well as on achieve- 
ment measures. Fourth, there must be measures of specific capacity 
including perceptual motor skills, sensory functions, concept for- 
mation, problem solving, and memory span. Fifth, the picture with 
respect to achievement in each of the academic and communication 
areas involved must be detailed sufficiently to clarify the spec'tic 
nature of students' difficulties and the resources available to them In 
meeting any learning demands. 

History 

Five highly related areas of significance bear careful objec- 
tive study in obtaining a comprehensive history of the problenr.. The 
first of these pertains to the family constellation and the children's 
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psychological role within the family group. Age, educational expe- 
rience and achievement, occupation, general health, interests, hob- 
bies, normal daily schedule, and general attitudes toward learning 
should be obtained for each person living in the home. A brief med- 
ical and social history of parents' families and the nature of the ex- 
tended family support in the past and in the present also should be 
acquired. 

Second, all facts pertinent to the prenatal, perinatal, and post- 
natal development must be obtained. Major importance is attributed 
to the record if, for example, the child was premature, or had neo- 
natal bilirubin encephalopathy or meningitis in early infancy. One 
might also wish to have a detailed obstetrical history in making an 
initial assessment of possible brain lesions in the fullterm newborn. 
There is conflicting evidence concerning the effect of prolonged la- 
bor, precipitous delivery, and intracranial pressure at the time of 
birth caused by forceps delivery or a narrow pelvic arch in the 
mother.; 

Pasamanick and Knobloch (1961) have coined the term **re- 
productive casualty" to account for the sequelae of harmful events 
during pregnancy and the birth process. Most of the resulting dam- 
age to fetuses and newborn infants is in the central nervous system. 
Because fetal and neonatal deaths are largely associated with com- 
plications of pregnancy or prematurity, these potentially brain- 
damaging events might result in children who do not succumb, but 
go on ,0 devebp a series of neuropsychia.»ic disorders. Depending 
on the specific nature and extent of the insult to the brain, the disor- 
ders might range from gross neurologic impairment to the more 
subtle specific and nonspecific problems labeled minimal brain dys- 
function or learning disability. It ma / that the greater vulnerabil- 
ity of the male fetus and neonate account for the higher 
incidence of learning problems among . 

Intensive studies of neonates are being made, nany dealing 
with those infants who fail to grow to normal size before binh. The 
surviv;.] of infants seems to be profoundly affected by the birth 
weight; tiie lower the v^clght of the newborn, the greater the danger 
he or sue faces. V/essel (1979) presents data to support the construct 
of a continuum of reproductive casualty, in that certain types of deliv- 
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ery clearly increase the likelihcxxi of later impaired or delayed per- 
formance. In addition, the findings of his investigation provide 
evidence that argues strongly for a dynamic-developmental-interac- 
tion approach to the diagnosis of learning disability. An analysis of 
Wessel's results supports the view that both constitutional and envi- 
ronmental factors are responsible for the impact of the birth process 
on the developmental status of the child. The use of at risk indicators 
should be only one step in determining the status and needs of the 
child. As the njcld (1985, p. 4) points out. 

At risk indicators do not always predict which child is in 
jeopardy of future developmental deficns or which aspects 
of development will be delayed or disordered. Caution 
should be used when informing parents about the presence 
of these indicators. For example, some children with a his- 
tory of perinatal complications may develop normally, 
while other children without such histories may demon- 
strate specific patterns of deficits that will require careful 
assessment and intervention. 

The maturational and developmental milestones should b** ex- 
plored carefully. Locomotion skills should be noted including the 
age of development of crawling, standing, and walking indepen- 
dently. Special attention should be paid to the development of 
speech and language, since the roots of most learning disabilities are 
found in the language area. For example, delay in oral language de- 
velopment is probably the best single indicator of probable diffi- 
culty in learning to read. 

The third area of importance in the history pertains to the 
medical and psychological record. Accidents, illnesses, immuniza- 
tions, hospitalizations, and behavioral characteristics noted preced- 
ing and following each of these instances should be included. It is 
often necessar}' for the clinician to follow up on a recorded medical 
episode or previous psychological evaluation by contacting the phy- 
sician or psychologist involved in the treatment for additional data. 
Once again, episodes that appear to have b rings on subsequent 
neurological or communication functioning will be of particular sig- 
nificance. 

4o 
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Fourth, it is important to acquire as much information as pos- 
sible about the social and emotional development of the child. 
Knowledge of the phases and stages of personality development is 
important in any assessment process of children with learning dis- 
abilities. Genetically, children's social and emotional adjustments 
are explored with questions related to their feeding habits, sleeping 
habits, nervous symptoms, early interpersonal relationships and 
first experiences in school. 

Finally, the entire school record is examined carefully. Chil- 
dren's social and emotional adjustments to fellow students and to 
their teacher are reviewed with as much care as their academic per- 
formance in each grade. Children's initial reactions to school; regu- 
larity of attendance; early symptoms of difficulty; attempts at that 
point to identify the problems and to provide assistance: referrals for 
diagnosis, tutoring, and remedial treatment -all may have bearing 
on their current difficulties and should be carefully recorded. Partic- 
ular attention should be given to the age of onset of the problem. 

Physical,, Social and Emovonal Status 

A thorough diagnosis of learning disability should include a 
visual screening designed to evaluate the coordinate functioning of 
the eyes. Specifically, the screening should be directed to detect prob- 
lems of visual efficiency -that is, accommodation (clearness of vi- 
sion), convergence (singleness of vision), and the relationship 
established between accommodation and convergence. The diagnosis 
and treatment of a visual problem belongs in the realm of the vision 
specialist who is trained to deal with such problems. But the diagnos- 
tician of reading and related learning disabilities should be equipped 
to screen out visual difficulty that may affect the child's ability to 
learn. Exclusive reliance on the Snellen Chart, which is only a mea- 
sure of visual acuity, is inadequate for detecting problems that might 
contribute to learning difficulty. Such procedures as the Keystone 
Visual Screening Test, the Ortho-Rater, or the Massachusetts Vision 
Test offer more comprehensive methods to detect visual anomalies, 
since they especially assess all aspects of visual efficiency. 

Hearing problems may p^ay a role in the etiology of learning 
disabilities. Since, in most schools, reading is taught as a process 
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whereby the child associates printed symbols with speech sounds, 
the student having a hearing loss may be readily confused. Some 
children do not experience any difficulty in auditory acuity, but are 
unable to discriminate between similar sounds (auditory discrimina- 
tion). There is wide agreement that an individual audiometric exam- 
ination should be used to screen for hearing defects. Further 
assessment of auditory acuity for children includes tests of speech- 
sound discrimination and informal observations. 

It is difficult to interpret the minor signs that suggest some 
type of central nervous system dysfunction in a significant number 
of presumably normal children. Some representative signs are ab- 
normal eye movements, clumsin .ss, visual-perceptual problems, 
and articulation defects. In recent years, neuropsychological evalua- 
tion has contributed greatly to our ability to diagnose learning dis- 
ability and to determine if the problems are intrinsic to the 
individual or result form some environmental causation. 

In assessing children's social and emotional status, the diag- 
nostician is concerned with children's ability to see things as other 
people see them, their capacity to relate to other persons, and their 
effectiveness in dealing with their idea^ and feelings in an adaptive 
manner. Clinicians attempt to leam how children cope with disturbing 
emotions. They explore the maneuvers children employ to bring 
about desired reactions from others; they also study the particular de- 
fense mechanisms children use that may facilitate or impede educa- 
tional progress. Abrams (1968) states that the ego defense 
mechanisms are the most important emotional factors affecting learn- 
ing. He feels that the emphasis in the assessment of the emotional 
status as it relates to learning disability should move away from the 
conflicts themsel es to the ego defenses erected to cope with these 
conflicts. 

Clinicians must also pay careful attention to the family con- 
stellation, how it may contribute to academic failure and be affected 
by or exacerbate a true learning disability. Abrams and Kaslow 
(1976, 1977) have written extensively about the role of family dy- 
namics in sustaining learning disability. They pay particular atten- 
tion to the hurt pride experienced by parents when their child does 
not measure up to their glarrorized image of their child. The psy- 
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chological preparation for a forthcoming child normally involves 
the fantasy of a perfect child, a kind of ego ideal. The parents may 
long for an offspring who possesses all of the characteristics they 
admire in themselves and who will not have all the traits they dislike 
in themselves. There is usually some disparity between the parents' 
dream child and the actuai child. To accept and resolve this discrep- 
ancy becomes a developmental task of parenjhood.. It is an aspect in 
the evolution of a healthy mother-child relationship. But when the 
disparity is too great -as in the birth of a baby with a handicap, or 
where the parents' wishes are too unrealistic— this may be too much 
for the parents' coping mechanisms. 

In addition to the clinical observations and the evaluation of 
the family constellation, psychological testing may make an impor- 
tant contribution to understanding the nature of the emotional fac- 
tors concomitant with the learning disability. Frequently, this part of 
the assessment includes projective testing. In responding to rela- 
tively unstructured materials, individuals will project their own 
ideas and feelings, conflicts and anxieties, on these stimuli and 
thereby furnish an x ray of their personality. By carelully interpret- 
ing the results of projective tests as well as the objective measures, 
the clinician may gain important clues to children's general effec- 
tiveness in a learning situation. 

Assessment of Intelligence 

It is axiomatic that a comprehensive clinical diagnosis re- 
quires the administration of an individual intelligence test. Although 
a number of such instruments are available, those devised by David 
Wechsler are most commonly used. In cases of reading disability, 
they are particularly appropriate, since they combine measures of 
verbal and nonverbal intellectual abilities and provide a scattering of 
subtests measuring specific abilities that appear to be highly related 
to difficulties in reading. In addition to the overall intelligence score 
and the comparison between verbal and performance tests as a 
whole, those subtests related to concept formation, vocabulary de- 
velopment, perceptual abilities, memory span, and visual-motor as- 
sociational skills are often particularly helpful to the clinician. 
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Although pattern analysis is f equently used in diagnosing 
learning disabilities, one must exercise considerable caution. There 
are clusters of test patterns associated with different types of reading 
disabilities, but this kind of analysis is effective only when it is car- 
ried out in a perceptive, nonbiased manner with attention given to 
the quality of the verbalizations and the behavioral observations as 
well. With this caution in mind, one can more profitably use an in- 
telligence test to detect certain perceptual and conceptual deficien- 
cies that are frequently m'inifested in learning disability syndromes. 
Denk'^ vl964) has discussed the kinda of errors made by the typi- 
cally braindamaged child; Abrams (1975), the intellectual pattern* 
ing expected in two types of dyslexics; and Pikulski (i978), the 
implications of intelligence-test findings in a variety of cases of 
reading disability. 

As stated previously, neuropsychologists have a signifi- 
cant contribution to our understanding of the unique characteristics 
of the learning disabled individual. The neuropsychological model 
includes traditional psychosocial knowledge and skills, but also uses 
an additional body of complex knowledge and clinical skills to pro- 
vide a better understanding of behavior and learning p.cHiems that 
include neurogenic \ariables. The neuropsychological cmtkibution 
has been particularly valuable in differentiating subtypes of reading 
disability. Specifically, with regard to intellectual assessment, two 
different types of developmental dyslexia have been identified. In 
the auditory linguistic dyslexic, there is a significantly lower verbal 
iQ than performance IQ. This group also shows the so-called acid 
pattern (Rourke, 1981). This is characterized by outstandingly poor 
performance on the wise Arithmetic, Coding, Information, and 
Digit Span subtests. This pattern tends to have a very poor progno- 
sis with respect to eventual recovery from reading retardation (Ack- 
ermr.n, Dykman, & Peters, 1976). In the visual-spatial dyslexic, ^he 
perf )rmance iQ is aif-^ificantly lower than the verbal iQ. The learn- 
ing dir-abled individual ypically has difficulty or the Block Design, 
Object Assembly, and Picture Comp etion subtests. 

A good clinician uses the results of an intelligence test in 
much the same way as a detective uses clues to solve a mystery. 
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Nothing is left to chance or just considered an anomaly. Every sub- 
test score, every response, and every part of every response must be 
viewed as significant and as representative of the subject. For exam- 
ple, there are individuals with ^earning disabilities who appear to 
manifest problems not in decoding (as we find in dyslexics), but in 
integration (conceptual difficulties). It is no^ at all unusual for a 
child to respond to a question such as "What are the four seasons of 
the year?*' with "Winter, Summer, June, and July.'' 

Assessment of Specific Capacities 

Perceptual motor abilities, while measured to some extent in 
certain subtests of the Wechsler scales, bear further evaluation. The 
Bender Visual-Motor Gestalt Test (1938) is the most frequently used 
measure of perceptual motor functioning. Several variations of the 
original procedure for administrating anc* ing this instrument 
have been developed. The results are often used (sometimes incor- 
rectly) to recommend a program of perceptual training. In fact, poor 
performance on the Bender Gestalt test may be ascribed to a number 
of different factors: perceptual deficit alone, motor dysfunction, in- 
efficient coordination of visual and motor processes, anxiety inter- 
ference, or simply negativism on the part of the child. 

The Frostig Developmental Test of Visual Perception (1963) 
assesses five areas that may be related to academic skills: figure- 
ground relationships, eye-hand coordination, form constancy, posi- 
tion in space, and spatial relationshipvS. Motor skills are necessary 
for adequate performance in each subtest. The dtvp yieM.s a "per- 
ceptual quotient*' with norms for children from ages four to seven. 
However, there is little evidence to suggest that the Frostig actually 
has the diagnostic ability to measure five separate visual perception 
skills. Some have ?.iso questioned whether the skills measured by 
the Frostig are significantly related \o achievement in school. 

In describing individuals with lea»'ning disability of the inte- 
grative type, Rappaport (1961) describes both perceptual and con- 
ceptual difficulties. There is some impairment in the areas of spatial 
relationships and spatial organization, figure-ground relationships, 
sequencing skills, visual imagery, visual-motor functioning, mem- 
ory, skip counting, and an inability to correct an error in a perform- 
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ance even after recognizing it. Under conceptual difficulties one 
might encounter associative word finding problems related to poor 
word retrieval, inadequate auditory processing skills, and difficulty 
in organizing a verbal response. Some children may make an arbi- 
trary guess to the question rather than admit not knowing the an- 
swer. 

Difficulties with atti^ntion and concentration may be related 
to learning disabilities. Although some memory abilities are in- 
volved in responding to most indl^'idual test items in any area, a 
specific memory span battery is helpful in identifying the nature of 
the individual's ability to attend to and retain stimuli experienced in 
different modalities. The Wechsler Memory Scale (1942) or specific 
subtests selected from the Detroit Tests of Learning Aptitude-2 
(Hammill, 1985) are often employed. Tests used to measure atten- 
tion and concentration should be composed of both discrete and re- 
lated items as well as stimuli presented in various modalities (visual, 
auditory, or a combination of these ). 

Using primarily neuropsychological evaluation, Pirozzolo 
(1981) identified specific characteristics of the homogeneous sub- 
ty s of dyslexia within a heterogeneous population. The children 
failing into the auditory-linguistic subtype show developmental ly 
delayed language onset; articulation disorders; anomia, object nam- 
ing or color naming defects; reading errors involving the phonologi- 
cal aspects of language; spelling errors characteristic of poor 
phoneme to grapheme correspondence; and letter by leUer decoding 
strategy. The children falling into the visual-spatial subvype of dys- 
lexia show right-I ft disorientation; finger agnosia; spatial dys- 
graphia (poor handwriting, poor use of space); reading errors 
involving visual aspects; spei, errors characterized by letter and 
word reversals; the use of a phonetic decoding strategy; and faulty 
eye movements during reading. 

Assessment of Educational Skills 

The educational evaluation of the child is of utmost impor- 
tance in determining the nature of the habilitative and remedial steps 
to be pursued. I* is the responsibility of the clinician to discern 
where the child is functioning in all aspects of language develop- 
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ment, such as listening, speaking, reading, and writing. More spe- 
cifically, one must appraise (1) how well the child's current 
achievement compares with intelligence level; (2) how performance 
matches the performance of other children of the same age; (3) what 
level of material the child can be expected to read independently and 
where the most profit from instruction will result (not to mention 
where there will be frustrations determined by the complexity of the 
material); and (4) how well evaluation of personal performance and 
awareness of personal deficiencies is made. 

Answers to many of the questions stated above can frequently 
be elicited by the intelligent use of formal inventories. Although the 
group reading inventory provides a valuable instrument for deter- 
mining levels of performance, a uiuch more thorough and diagnos- 
tic method is to appraise the performance of each pupil individually. 
In essence this procedure consists of having the child read orally at 
sight and then silently from a series of reading selections that in- 
crease in order of difficulty. Comprehension is checked by means of 
factual, inferential, and vocabulary questions. Information regard- 
ing achievement levels and specific deficiencies in language and 
reading can be gleaned from the proper administration of an infor- 
mal reading inventory. 

Individuals with severe reading disabilities most frequently 
experience difficulty in decoding. Dyslexia is not characterized by 
satisfactory decoding and poor comprehension. Word substitution, 
reversal of letter sequence, and letter or word omission, as well as 
slow rate, are commonly observed. Often the child has tremendous 
difficulty in acquiring an adec jate sight vocabulary for reading. Bo- 
der (1973) has suggested that analysis of the types of errors in read- 
ing and spelling may provide a classification of dyslexics as having 
visual or audiiory processing difficulties, or both. The dysphonetic 
dyslexia group reflects a primary deficit in letter-sound integration 
and in the ability to develop phonetic skills. Lacking phonetic skills, 
these children are unable to decipher words not in their sight vocab- 
ulary. The dyseidectic dyslexia group reflects a primary deficit in 
the ability to perceive whole words as gestaits. These children read 
phonetically, sounding out most words as if they were being encoun- 
tered for the first time. The alexia group reflects a primary deficit in 




3 Abrams 



both the ability to develop phonetic word analysis (synthesis skills) 
as well as in the ability to perceive letters and whole words as visual 
gestalts. This child can be differentiated from the dysphonetic child 
by a significantly lower sight vocabulary, and from the dyseidetic 
child by a lack of word analysis skills. It is clear that Bodef s classi- 
fication is similar in many ways to Pirrazola's subtypes although the 
data are derived from a different kind of evaluation. 

Summary 

In the dynamic-developmental-interaction approach tu the di- 
agnosis of reading and related learning disabilities, we have stressed 
the importance of a multidisciplinary orientation. Competent assess- 
ment procedures require that the child be evaluated with a sound 
conceptual framework. There are many possible pitfalls in the eval- 
uation of any individual with a learning disability. It is certainly im- 
portant that the observations and testing be perceptive and accurate. 
The interpretation of both clinical and test findings oepends to a 
large extent upon the competence of the diagnostician. 

To summarize, there are significant requisites for applying 
the dynamic-developmental-intera^ Mon approach to the diagnosis of 
reading disability: 

1 . The individual with disability must be viewed m a holistic 
fashion with attention paid to the biological, psychologi- 
cal, and social pnx^sses in complex interaction with one 
another. 

2. There should be a ognition of the differentiatioii be- 
tween reading problems and reading disability. 

3. It must be recognized that reading disability is one of 
many types of learning disability; learning disabilities are 
heterogeneous in nature. 

4. There are different subtypes of reading disability which 
require different types of remediation and intervention. 

5. Sensitivity and skill are essential in obtaining a longitudi- 
nal history from reliable informants. 

6. The case history provides the contextual framework in 
which to understand our clinical observations and test 
results. 
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7. The evaluation procedures must attend to the emotional 
concomitants of the disability as well as the cognitive fac- 
tors. 

8. The multidisciplinary perspective allows the diagnosti- 
cian(s) to give equal consideration to all the factors which 
affect and sustain readin*; disability. 

9. It is the manner in which the contact with the child is 
maintained that determines the success or failure more 
than anything else. 

10. A psychodynamic, affective approach to individuals with 
reading disability must renlace the more traditional orien- 
tation, which has separated the cognitive from the emo- 
tional realm, a dichotomy that is superficial. 
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Holistic Assessment of Coding Ability 



This chaptei describes informal holistic methods by which 
teachers can observe students' developing mastery of the cod- 
ing system as they learn to read and write. The suggested methods 
depart from traditional ones that use noni^ense syllables or words in 
isolation to assess coding ability separate from the other language 
processes that all readers and writers must use if they are to make 
sense of print. The chapter has two major thrusts; looking carefully 
at children's early writing and listening carefully to their oral read- 
ing. 

According to K. Goodman (1986, p. '^8), "Three language 
systems interact in written language: the grapaophonic (sound and 
letter patterns), the syntactic (sentence patterns), and the semantic 
(meanings)." Of the three, only the graphophonic (coding) system is 
unique to written language. For those who espouse a holistic point 
of view, however examining the graphophonic system is not possi- 
ble without attention to the other systems and to the pragmatic con- 
text in which they are being used. Even a separate chapter focusing 
on coding is somewhat suspect, perhaps because of simplistic 
claims by Rudolf Flesch and others that mastery of the coding sys- 
tem is all there is to learning to read. Beliefs like these have resulted 
in early reading materials that present the coding system to children 
in meaningless fragments, divorced from context and meaning. 

I believe it is important for children to master the coding sys- 
tem and to use it automatically. I believe with Perfetti (1984, p. 56, 
that **^cquisition of the alphabetic code is a critical component- in- 
deed the definitive component-of reading in an alpiiabetic lan- 
guage." Knowledge of how the coding system works can have 
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tremendous advantages for every leamer-not just those at risk- 
and, according to Perfetti, there are "no known negative conse- 
quences" to helping children understand the system. Resnick (1979, 
p. 329) agrees, noting that "as a matter of routine practice, we need 
to include systematic, code oriented instruction in the primary 
grades, no matter what else is also done. This is the only place in 
which we have any clear evidence for any particular practice." She 
goes on to state that we cannot afford to ignore that evidence, but we 
also cannot assume that merely mastering the code will solve all 
reading problems. She suggests that a code and language emphasis 
are needed foi successful literacy programs. 

Whole language proponents do not dismiss the evidence pre- 
sented, but they believe instructional programs can be organized so 
that mastery of the coding system can occur naturally. (See K. 
Goodman, 1986 and Holdaway, 1979 for suggestions on how this 
might be done.) Goodman (1986, p. 38) believes children will dis- 
cover the alphabet!: principle when they learn to write. "Whole lan- 
guage programs and whole language teachers do not ignore 
phonics; rather, they keep it in the perspective of real reading and 
real writing." Whole language programs lave not been tried in this 
country, and there are few studies that offer evidence of their effec- 
tiveness. Because these programs emphasize the interactive nature 
of learning and build on the strengths that children bring with them, 
they hold great promise. In one study, children at ristr were im- 
mersed in a language and print rich environment characterized by 
many opportunities to observe, try out, and practice literacy skills. 
They performed significantly better on both informal and standard- 
ized tests than those who were offered a typically f»*agmented and 
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less meaningful worksheet approach (Taylor, Blum, & Logsdon, 
1986). 

Documentation of effectiveness of whole language programs 
for all children is still to come. Some poor readers who have been 
through the programs now available (and which are used by 90-95 
percent of teachers) have not mastered the coding system. Olson and 
his colleagues (1984) repon their «tudy of disabled readers that 
showed them to be deficient in phonological coding. Liberman and 
Shankweiler (1985) report studies indicating that illiterate adults 
have difficulty with tie coding system, indicating that insight does 
not necessarily accomp^any age and exposure. Breaking the code- 
mastering the graphoyhonic system, understanding the alphabetic 
principle, and recognizing familiar orthographic patterns- is im- 
portant. Children who do not acquire these insights are at risk for 
learning to read. 

What do beginning readers of any age need to know in order 
to master the coding system, and how can we tell whether these 
things are being learned? 

Components of the Coding System 

According to Y. Goodman (1984), one of the major roots of 
literacy is conscious awareness of its function, form, and context as 
evidenced in certain basic principles. Understanding the codi.,g sys- 
tem begins with exploring the relational principles, or as Y. Good- 
man (p. 105) puts it, "understanding that some unit of written 
language represents some unit of meaning." Ferreiro and Teberosky 
(1982) documented the development of this understanding and con- 
cluded that children appear to progress in seven levels of interpreta- 
tion, as follows: 

LeveJ 1. Children do not differentiate between a drawing and 
written language. 

Level 2. Children begin to make this differentiation. 

(However, Gibson and Levin, 1975, report studies 
indicating that few three year olds are unable to do 
this, even when the writing is in an unfamiliir lan- 
guage and when they come from an environment 
that is not print rich, e.g., the Yucatan.) 
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Level 3. Children begin to use the symbols prevalent in their 
culture's orthography. They may write only strings 
of numbers and letters, but "read** from these as text, 
telling their own stories. 

Level 4. Children create their own interpretation of how the 
spoken language is related to written language. ^Y. 
Goodman, 1984, provides an example with the story 
of Eric, age four, who read "cee-ree-ull," stretching 
out the syllable until he had finished pointing to the 
words Kellogg's Raisin Bran.) 

Level 5. Children begin to use a syllabic hypothesis, one 
symbol to represent one syllable. 

Level 6. Children combine both a syllabic and an alphabetic 
hypothesis. (This level has been analyzed exten- 
sively by several researchers -Gentry, 1982; Hen- 
derson & Beers, 1980; Read, 1975-who have 
studied how early writers use the coding system.) 

Level 7. Children break the code and begin the discovery of 
the conventional spellings used in their respective 
orthographies. 

Understanding the coding system begins with understanding 
the functional principle of literacy. Most children will read environ- 
mental print in ways that indicate their awareness of the functions of 
print long before they go to school. They may indicate that a stop 
sign says "don't go," for example, or that a Shell sign says "gas," or 
that a Colgate label sa^ . "toothpaste." As Heath (1982) has demon- 
strated, parents' attituu^s toward print and the ways they use it help 
develop functional principles in their children. 

Central to mastering the coding system is children's under- 
standing of the linguistic principles of literacy. According to Y. 
Goodman (1984, p. 108), "Evidence shows that children hypothe- 
size about all the lingui.stic cueing systems needed for written lan- 
guage. The orthographic system -including directionality, spelling, 
punctuation, and form variations, as well as the graphophonic sys- 
tem— new to children. The phonologic, syntactic, semantic, and 
pragmatic systems are developed through oral language use, and 
children exhibit a growing awareness of how these systems operate 
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differently under the constraints of written language r 

In order to master the coding system, then, children must ac- 
tually understand the orthographic and the graphophonic component 
systems. 

The Orthographic System 

Mastery of the orthographic system implies an understanding 
of basic concepts about print -important learnings that are often 
taken for granted by teachers but can seriously impede progress if 
children are confused about them (Clay, 1979; Holdaway, 1979). 
Indications of mastery of the orthographic system are the recogni- 
tion of common English spelling patterns or chunks, the knowledge 
that only certain letter strings are allowable in English (words com- 
monly end, but never begin with ng), and the immediate recognition 
of high frequency words as wholes. 

To assess children's developing awareness of many aspects of 
the orthographic system. Clay (1979) offers her Sand and Stones 
tests, small booklets designed to measure basic concepts about 
print. An objection to these tests is the use of mutilated text. The 
following suggestions, adapted from Holdaway (1979), aid teachers 
with informal assessment. 

1 . Hand the child a book (spine pointing to the child) and 
ask the child to open it. Does the child know the spine 
goes on the left? 

2. Ask the child to show you where you should begin read- 
ing. Does the child know the story begins where the print 
begins? 

3. Ask where you should go next. Does the child know that 
the left hand page comes uefore the right hand page? 
That you move from the top to the bottom of the page? 
That you begin at the left and go along the line to the 
right and that you return to the next line on the left mar- 
gin? 

4. Give the child two index cards and ask him or her to 
frame one word; two words; one letter; two letters. Does 
the child know the concepts of word and letter? 
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5. Show the child a period, a question mark, a comma, an 
exclamation mark, quotation marks, and an apostrophe 
and ask what they are for. Does the c-'Ud know? 

6. Can the child follow a line of print in an enlarged text 
using word spaces? 

7. Does the child use the concept of word fit? That is, does 
she or he know when there are too many or too few 
words? 

8. Does the child realize that texts remain the same; that 
print is a stable word by word record of language? 

9. \Jocs the child understand the consistency principle, that 
the same word always ha? the same spelling? 

Using these questions to guide reflective observation should 
help determine children's developing mastery of the orthographic 
system. 

The Written Language Awareness Test cited by Taylor, Blum, 
and ^ogsdon (1986) also appears to be a useful tool for examining 
some aspects of orthographic awareness. It measures "the ability t'> 
segment oral sentences into their component words, the understand- 
ing that the spoken word is a cue to ;he length of the printed word, 
awareness of the technical aspects of written language and familiar- 
ity with the orientation of books, and attention to and use of graphic 
information in a cloze situation" (p. 134). As v/ith all tests, the prag- 
matics of the situation and the meaningfulness of the tasks must be 
considered. 

The Graphophonic System 

Mastery o'' he graphophonic system entails an understanding 
of the relationship between speech and print. As Ehri (1979, p. 63) 
has written "If the light were not so gradual in dawning, the relation- 
ship between speech and print might count as one of the most re- 
markable discoveries of childhoor^" In ed ^cation?' terms (which 
often ignore basic prerequisite understand.**gs), understanding the 
graphophonic system has been taken to mean understanding the idea 
that letters have some relationship to speech sounds, commonly 
called phonics. However, Wallach and Wallach (1979) and Haddock 
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(1976, 1978) have documented the importance of being sure chil- 
dren go beyond associating a particular sound with a particular letter 
to understanding the idea of segmentation and recombining as part 
of their learning of the alphabetic principle. Children need to under- 
stand the basic idea that sounds and letters are reusable. When the m 
is segmented from mother, for example, you can substitute br and 
get a whole new v^ord— brother. Children who understand this seg- 
menting and recombining principle are well on their way to under- 
standing how the graphophonic system works; those who do not arc 
likely to have great difficulty learning to read (see Lundberg, 1985; 
Olson et al., 1984; V/aiiach & Wallach, 1979). 

In addition to obtaining clues about children's basic under- 
standings about print, observing their early writing and listening to 
their reading provide insights about their understanding of the 
graphophonic system. 



Children's Early Writing 

K. Goodman (1986) suggests that children will acquire the 
coding system as they begin to write. It has been recommended that 
the writing process become a part of all literacy programs beginning 
with kindergarten (see Calkins, 1986; Graves, 1982 for specific 
procedures on how to undertake such programs). If writing p^'ecedes 
reading as Chomsky (1979) has implied, teachers should be able to 
examine children's writing for indications of their understanding of 
the orthographic and graphophonic systems and make nypotheses 
about their understanding of code in their reading as well. An exam- 
ination of children's writing reveals many of their basic understand- 
ings of concepts about print, knowing that it is print that "tells the 
story*" or the intricate aspects of directionality. Children's writing 
also reveals their understanding of concepts of letters (they generally 
begin w'th uppercase), spaces (they generally begin with no.ie), 
words, letters, and punctuation marks. Bissix (1980) provides two 
wonderful examples of her son Paul's developing , lastery of the or- 
thographic system: rudf (Are you deaf?!) at five years, one month, 
and EFUKANOPNKAZiwiLGEvUAKNOPENR (If you Can open cans I 
will give you a can opener) at five years, 2 months. 
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It is possible that teachers can learn much about their stu- 
dents' developing mastery of the graphophonic system (including 
their memory for sound-letter correspondences and their ability to 
segment and recombine) by examining their invented spellings and 
listening for comments about their discoveries about print as they 
learn to write. Flores and Garcia (1984) developed a checklist based 
on the developmental stages suggested by Ferriero and Teberosky 
(listed earlier in this chapter), but I believe an intensive analysis of 
Level 6 (children combine both a syllabic and an alphabetic hypoth- 
esis to represent units of meaning) will yield additional useful infor- 
mation regarding children's use of the coding system. Analyses of 
children's invented spellings by several researchers (Beers & Hen- 
derson, 1977; Gentry, 1982; Henderson & Beers, 1980; Read, 
1975) have revealed developmental stages in children's early spell- 
ing and writing that reflect their hypotheses about how the coding 
system works. If teachers use the following stages (adapted from 
Gentry, 1982) as part of their checklists (see Figure), they should 
acquire insights into children's developing mastery of both the or- 
thographic (og) and graphophonic (gp) aspects of the cvy'ing sys- 
tem. Gentry's descriptions of the stages are interspersed with the 
comments of Morris (1984) who used similar stages to document 
the development of children's concepts of words. 

Stage 1. Precommunicative Stage 

At the Precomnunicative Stage, the beginning writer 

1. Demonstrates some kiiowledge of the alphabet by using 
letter forms to represent a message, (og) 

2. Shows no evidence of knowledge of letter-sound corre- 
spondences. The writing appears to be a random stringing 
together of letters that may also include number symbols. 

(OG) 

3. May or may not use the principle of left-to-right direction- 
ality, (og) 

4. May know only a few letters which s/he repeats over and 
over or may evidence substantial knowledge of the alpha- 
bet, (og) 

5. May mix upper and lowercase letters indiscriminately, but 
tends to show a preference for uppercase, (og) 



£ |^(^ Hstic Assessment of Coding Ability , 55 



Checklist for Developmental Stages in Early Writing* 



Name. 



Age. 



Grade . 



I II III IV 



Precommunicadve Stage Date 

1 . Produces letters or letter like forms to represent a 
message. 

2. Includes number symbols as part of message? 

3. Demonstrates left-to-right concept. 

4. Demonstrates top-bottom concept. 

5. Repeats known letters and numbers. 

6. Uses many letters and/or numbers. 

7. Mixes upper and lowercase letters. 

8. Indicates preference for uppercase forms. 

The Semiphonetic Stage Date 
I Realizes letters represent sounds. 

2. Represents whole words with one or more letters. 

3. Evidence of letter name strategy 

4. Demonstrates left-to-right sequence of letters. 

5. Puts spaces between words. 



Date 



The Phonetic Stage 
\ . Represents every sound heard. 

2. Assigns letters based on sounds as child hears 
them, (invented spellings) 

3. Puts spaces between words. 

4. Masters letter formation. 

The Transitional Stage Date 

I . Utilizes conventional spellings. 

2 Vowels appear in every syllable 

3. Evidence of visual as opposed to phonetic strategy. 

4 Reverses some letters in words 



□ 



Comments . 



♦Adapted from J Richard Gentry, An analysis of developmental spelling in gnys at 
WRK The Reading Teacher. 1982, i6. 192-199 
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Stage 2. Semiphonetic Stage 

In the Semiphonetic Stage, the beginning writer 

1. Begins to conceptualize that letters have sounds that are 
used to represent the sounds of words, (gp) 

2. Uses letters to represent words which provide a partial 
mapping of phonetic representation for the word spelled. 
Semiphonetic spelling is abbreviated; one. two, or three 
letters may represent the whole word, e.g., mzr (mon- 
ster). (GP) 

3. Evidences a letter name strategy. Where possible, the 
writer represents words, sounds, or syllables with letters 
that match their letter names, e.g., R (are); u (you); left 
(elephant), instead of representing the voxvel and conso- 
nant sounds separately. This is Ferreiro ?nd Teberosky s 
Level 5 (children begin to use a syllabic hypothesis -one 
symbol to represent one syllable), (gp) 

4. Begins to grasp the left-to-right sequential arrangement of 
letters in English orthography. (OG) 

5. Evidences greater knowledge of the alphabet and greater 
mastery of letter formation. (oG) 

6. May or may not begin to leave spaces between words. (OG) 

Within the semiphonetic stage (or prephonetic as he calls it), 
Morris (1984) suggests there are three substages. Prephonetic 
spellers usually begin with the beginning letter of a word, then add 
the ending letter, but can't give the vowel. They often omit it or (ex- 
hibiting orthographic awareness, there's something in the middle) 
put in a filler vowel. A pr .phonetic speller might spell back as /; Ik\ 
or hoc. 

Stage 3. Phonetic Stage 

At the Phonetic Stage, the beginner v ''iter 

1. Is able to provide a total mapping of letter-sound corre- 
spondences; all of the surface sound features of the words 
are represented in the writing, (gp) 

2. Systematically develops particular spellings for certain de- 
tails of phonetic form. In representing short vowels, pho- 
netic spellers often categorize the short vowel they are 
trying to spell with the nearest long vowel in place of artic- 
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ulation; then they use the long vowel letter name in the 
spelling. For example, both the short / and the long e 
sounds are produced in the high front part of the vocal 
tract. Therefore, when children attempt to represent the 
short / sound in stick, they substitute the letter name of the 
nearest vowel, e, producing the spelling sek. Likewise, a 
phonetic speller attempting to spell bed will often produce 
bad, categorizing short e and long a together (both mid- 
front vowels) and using the letter name A in the spelling. 
Phonetic stage spellers also omit vowels when they are not 
heard in a syllable (e.g., table-tabl) and nasals {m and n) 
when they precede stop consonants (e.g. stamp -stap or 
sink-sek). According to Morris, a phonetic speller would 
spell back as bac or bak. Children al this stage indi'^ale 
extreme sensitivity to phonetic principles like affrication. 
For example, the point of articulation for the t in trick is 
the same as in c/i, and both are affricates. Some children 
pick up on these similarities and spell ash tray as as chray 
and tarantula as chrachela. This same sensitivity is exhib- 
ited in their spelling of intervocalic flaps, which occur 
when an alveolar stop (d or t) intervenes between two vow- 
els if the preceding vowel carries a greater degree of stress 
than the following one. In this position, th'^e is no contrast 
between the / and the ^-both are realized as a short tap of 
the tongue on the alveolar ridge. Because this flap is al- 
most always voiced, it is phonetically closer to d. Exam- 
ples cited by Read (1975) include prede for pretty, bodom 
for bottom, adsa^nn for eighty-seven, and gadichans for 
get a chance. Examples from a child's recounting of a trip 
to the zoo include cheda and ciyode. (gp) 

3. Assign letters s;rictly on the basis of sounds, without re- 
gard % acceptable Englisf letter sequence or other con- 
ventions of Eiiglish orthography. More zoo examples 
included glopcis todl (Galap?g05 tunle), pcoc (peacock, 
spidr monces and ranatags. (gp) 

4. Generally (but not always) use conventional spacing be- 
tween words, (gp) 
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Paying particular attention to what children s'^y as they write 
can reveal their developing awareness of the alphabetic principle of 
segmenting and recombining, a learning Ehri (1987, p. 15) believes 
contributed to the transfer of instruction in spelling certain words to 
children's ability to read those words. Bissex (1980) gives an excel- 
lent example of this. She noticed that as her son Paul was writing he 
said "You spell *book' b-o-o-k. To write *look' you just change one 
letter; take away the B and add an According to Gentry, these 
mental spellings and rehearsals (Paul also observed that "if you take 
the T ai:d R off *triLe' and put a B in front, you have "bike' ") pre- 
pared him for the next stage of spelling. 

Stage 4. Transitional Stage 

At the transitional stage, the beginning writer 

1. Adheres to basic conventions of English orthography: 
Vowels appear in every syllable; nasals are represented be- 
fore consonants; both vowels and consonants are em- 
ployed instead of a letter-name strategy; a vowel is 
represented before syllabic r even though it is not heard or 
felt as a separate sound; common English letter sequences 
are used in spelling, especially liberal use of vowel di- 
graphs like a/, ea, ay, ee, and ow\ silent e pattern becomes 
fixed as an alternative for spelling long vowel sounds; m- 
flectional endings like s, ing, and est are spelled con- 
ventionally. An interesting example of anticipating this 
stage was the v.riter who vi*^ . the zoo. He spelled cage 
as caga, ei.her exhibiting orthographic awareness that 
something came after the g or representing something he 
heard as he attempted the spelling as in cagenh. In the 
transitional stage this e is represented correctly. 

2. Presents evidence of a new visual strategy -the child 
moves from phonological to morphological and visual 
spelling. (OG) 

3. May include all appropriate letters, although some may be 
reversed. Many teachers will recognize this stage as the 
one when they get not(^ saying "I love yuo, Ms. Mr. 

(00) 
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Morris notes that transitional spellers move to a more ab- 
stract, if still nonstandard, representation of hnglish words. These 
transitional spellings, which begin to appear in late first or early 
second grade, are to be welcomed by the teacher because ♦liey signal 
emergence of an underlying abstract word knowledge. Transitional 
spellers would probably spell back correctly, according to Morris, 
but examples of other transitional speiiingb might htfete for ''^et or 
tabel for table. 

It appears that by using the stages explicated by Gentry 
(1982) and Morris (1984) and by examining even the earliest writ- 
ing attempted by children, teachers can determine what kinds of hy- 
potheses their students are making about all aspects cf both the 
orthographic and graphophonic components of the coding system. 
To check awareness of the orthographic system, they can, through 
careful observation, gather evidence indicating their students a/e 
distinguishing print from drawing, beginning to understand the in- 
tricacies of directionality, developing a growing awareness of the 
function ui spaces and word boundaries, beginning to control letter 
forms, developing understanding of the uses of punctuation, and us- 
ing invariant spellings ror common words and patterns. To deter- 
mine understanding of the graphophonic system, they can note in 
specific detail the stages of development revealed by their students' 
invented spellings. Children's writing also seems particularly useful 
for determining Insights they are acquiring beyond straight phoneme 
to grapheme mapping. When children begin to notice, as Paul did, 
(Bissix, 1980) that "if you take the L out of 'glass' and push it all 
together you get 'gas'," they have truly understood the alphabetic 
principL. 

The following story about a trip to the zoo, written by a first 
grade boy, illustrates many of the concepts discussed above. 

My favorite day in D-8 was My favorite day in D-8 was 

when we went to the zoo. fhrst when we went to the zoo. first 

we got on the Bus sacnt we wr we got on the Bus second we were 

on or way to the zoo thrd we wer on our way to the zoo third we were 

getmg of the bus and we tok getting off the Bus and we took 

or luchis. and we prt or lunches our lunches, and we put our lunches 
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on the cort and then or techer tok 
or lunches to the lunchroom. 
And when she got bak we whent 
whith or group and we whent to see 
animals fhrst we whent to see 
the snacs and a chrachela 
and then we whent lO the dazrt 
mazeum and we so the manliens 
and then we whent to see the 
chida But the cheda was in its 
caga so we went to see the graf 
and we so a bab> graf and we 
so the Rinosrisis and there wher 2 
Rinosrisis and we so the lien 
and then we whent to see the 
pcocs and and the ciyodes and 
then we whent to the other animals, 
and we so a popet sow and after 
we so the popet sow 
we whent .o pet the animals and 
then we whent to see the Glopcis 
todl and then we at lunch and then 
we so a pcoc wili we 
were eating lunch 
we so 2 pecocs and we so the 
spidr monces and we so the 
ranatags and the we whent 
bac to the Bus and then we whent 
bac to scooL 



on the cart and then our teacher took 
our lunches to the lunchroom. 
And when she got back we went 
with our group and we went to see 
the animals first we went to see 
the snakes and a tarantula 
and then we went to the desert 
museum and we saw the mountain 
lions and then we went to see the 
cheetah But the cheetah was in its 
cage so we went to see the giraffe 
and we saw a baby giraffe and we 
saw the Rhinoceros and there were 2 
Rhinoceroses and we saw the lion 
and then we went to see the 
peacocks and and the coyotes and 
then we went to the other animals, 
and we saw a puppet show and after 
we saw the puppet show 
we went to pet the animals and 
then we went to see the Galapagos 
turtle and then we ate lunch and then 
we saw a peacock while we 
were eating lunch 
we saw 2 peacocks and we saw the 
spider monkeys and we saw the 
orangutans and then we went 
back to the Bus and then we went 
back to school. 



This child obviously has mastered directional principles. He 
knows where the print should go and is developing concepts of peri- 
ods and capital letters. (Commas are not yet in evidence.) He retains 
some letter name strategies, as m snacs and we at lunch, but almost 
all of his invented spellings are phonetic and reflect considerable 
knowledge of the graphophonic system. It is possible to hypothesize 
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about many of them, saw spelled so because he has been taught 
•'short o'l Did he insert an /i in whent and fhrst and whith because he 
is listening to his own pronunciations of the words as he writes (seg- 
menting and recombining) and he hears an aspiration? Did he insert 
the a at the end nfcaga because he s aware there is something at the 
end (orthographic awareness), or does he hear cage-uh as he care- 
fully pronounces the word? 

This child s awareness that the intervocalic flap in coyote and 
cheetah is pronounced as a is reflected in his si^W'mgs -ciyode and 
cheda. He hears the affricated sound of t and r together in tarantula 
and spells it chra^hela. Vowels are not used in every word, but the 
developing awareness of them is clear. Peacock is spelled pcoc two 
times, but the last time he uses it he spells it pecoc. The exploration 
with variable consonants also can be seen. He spells back as bac and 
bak, but it carft be long before this child notices that both letters are 
required. 

The examination of only a small portion of the writing that 
beginning readers should be doing dailv is likely to yield rich in- 
sights into their hypotheses about the coding system. And it will 
provide rich materials for hypothesis mak.ng for the teacher as well. 



Children's Oral Reading 

As children begin to learn about written language in an envi- 
ronment that stresses meaning and is rich in providing information 
from which they can formulate hypotheses about how it all works 
(Goodman & Goodman, 1979; K. Goodman, 1986; Holdaway, 
1979; Taylor, Blum, & Logsdon, 1986 for detailed descriptions of 
such environments), it is also possible to gain insight about their use 
of the coding system by listening to them read. Just as examining 
childrens writing can provide clues about these developing hypothe- 
ses, K. Goodman (1979, p. 3) has noted ^hat the miscues children 
make when they read are "windows .j the mind** that allow the 
teacher to make predictions about tne child's understanding of the 
coding system in the context of the other systems of language. 

In 1972, Y. Goodman and Burke published the Reading Mis- 
cue Inventory (rmi), which was design'*'^ o help researchers, read- 
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ing specialists, and teachers do a qualitative analysis rather than a 
quantitative assessment of children's oral reading mi^'^urjs. This was 
very different from the conventional informal reading r enlory that 
emphasized the reading of short paragraphs in test situations, 
the counting of pronunciation errors, and the use of a tew questions 
(often only tangentially related to the reading) to determine compre- 
hension. The RMi and adaptations of it still appear to be the most 
meaningful way to assess developing mastery of the coding system 
(as only one of the systems used in reading). Differences between an 
expected response and an observed response are looked at in terms 
of how the reader is using graphic, phonological, syntactic, and se- 
mantic information in the pragmatic situation in which the reading 
is taking place. This means whole text is used (no fragments) that is 
long enough to allow the readers to use their language abilities and 
reading strategies. The oral reading and the retelling of the selection 
are taped, miscues are marked and analyzed, and a profile of reader 
strengths is prepared and used to plan r reading program. 

Specific use of the coding system is looked at in the rmi or in 
adaptations of it (see Anderson, 1984; Cochrane et al., 1984 for 
detailed descriptions of these adaptations) by examining reader sub- 
stitutions for actual words in the text. These substitutions are coded 
for graphic similiarity to the text word (do they look alike?) and 
phonological similarity (do they sound alike?) with judgments of 
yes, some, or no. An examination of at least twenty-five miscues can 
determine whether a reader is using the coding system to confirm 
predictions that also make sense syntactically and semantically. In 
the Cochrane et al. adaptation of the rmi, teachers ask four ques- 
tions: Did the reader use graphophonics when s/he substituted this 
word for the wed in the text? Does what the reader reads sound like 
language? Does what the reader reads make sense? Does the reader 
change the author's intended meaning? 

Analys s of a reader's use of the coding system in the context 
of the others is extremely 'Tiportant. As Cochran et al. (198^, p. 25) 
noted, "If the use of one uf ihe language cues is stressed over an- 
other, children will likely overuse that cue and neglect the other cues 
available to them." If a child substitutes daddy for father in her oral 
r-^ading, her strength in using meaning and syntax to predict the ex- 
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p-^cted .vord is to be celebrated and taken a step farther to help her 
use the coding system to confirm her predictions. If a child should 
sa^ feather for father, ho\/ever, a strength in using the coding sys- 
tem may be celebrated while the child is helped to use what she 
knows about r.eaninp to make a more realistic prediction. 

Although the original rmi was complicated and some A^hat im- 
practical for classroom use, a recent revision by Goodman, Watson, 
and Burke (1987) presents three alternatives to the original which 
make it practical for every classroom teacher. They give greatly 
simplified procedures for determining a child's mastery of the cod- 
ing system in the context of the others. 

To simplify even further, Holdaway (1979) has suggested that 
teachers regularly take running records of children's oral reading of 
texts they haven't seen befoie (perhaps keeping an audiotape for 
each child), mark their miscues as suggested in the rmi, and deter- 
mine whether they are self-correcting as they read. This differs from 
the xMi in that no retelling is taken for comprehension assessment 
and no formal coding of miscues takes place, thus shortening the 
process considerably. He believes that children's ratio of self-correc- 
tions to total number of miscues is the "best index of healthy proc- 
essing, and provides a clear idea of which children are having 
difficulty in developing sound central strategies" (p. KZ). He cau- 
tions that children should read i.iaterial in which they make no more 
than one (uncorrected) miscue in twenty words. 

Summary 

The use of nonsense words and tasks to test children's mas- 
tery of the coding system was not considered in this chapter, al- 
though it is common enough in practice. Careful observance of 
childrens writing, close attention to what they say about their dis- 
coveries about prim as they learn to write, and qualitative consider- 
ation of ♦heir miscues as they read whole text should give 
diagnosticians enough insight into childre-'. use of both the ortho- 
graphic and graphophonic aspects of the coding system to enable 
them to build on the considerable strengths that all children brir g to 
the process of learning to read. 
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Comprehension Assessment: 
Alternatives to Standardized Tests 



When we discuss the topic of assessment (the use of standard- 
ized reading comprehension tests in particular) teachers ask 
"Which standardized test would you recommend our school district 
use?" The major point we stress is that the primary concern about a 
reading comprehension assessment treasure is the degree to which 
it represents real reading tasks and situations. In our judgment, 
standardized reading comprehension tests are not representative of 
the reading tasks students are assigned in the classroom. In fact, 
Johnston (1984, p. 169) alluded to the notion that much of what we 
currently do in the name of reading comprehension assessmeiit can 
be characterized as strange or abnormal. 

In this chapter we trace the historical development of stand- 
ardized reading comprehension tests to show they were developed 
for the sake of convenience in test construction and scoring rather 
than for diagnostic intcrmation. We will make a case for the use of 
informal measures of reading comprehension; discuss the use of in- 
formal measures such as miscue analysis and the content reading 
inventory; and describe the role of observation as a means of read- 
ing comprehension assessment, providing examples of its use. The 
purpose of this chapter is to provide teachers with alternativ-s to 
consider * gathering diagnostic information about their stucents' 
comprehension instructional needs. 
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Comprehension assessment 



Standardized tests 



Historical Lack of 
overview diagnostic 
I information 

Testing for 
conv^ ^lence 



Informal tests ' Observation 

\ / \ 

Ecological Examples 
validity I 



Multiple 
measures 



I 

Direct Instruction 

I 

Use of comprehension 
strategies 



Why Questions? 

The purpose of standardized reading comprehension tests is 
to compare performances of various groups of students at a particu- 
lar grade level. In this way, school districts can see how their stu- 
dents compare nationally and can make decisions about the quality 
of the instructional program offered. 

The typical standardized reading comprehension test format 
however, consists of reading short paragraphs and answering ac- 
companying multiple choice questions. Such a format provides a 
limited measure of how well students comprehend text (e.g., Farr & 
Carey. 1086). Choosing appropriate answers to ques^^ons is just one 
indicator of reading comprehension. Students can show they have 
understood a text by producing miscues, retelling passages, or 
dramatizing stories. 

Students restricted to answering questions do not have an op- 
portunity to display other important comprehending behaviors. For 
instance, students are not able to demonstrate their ability to pose 
questions, justify their answers, or anticipate what is coming in the 
text. Given these limitations, why do questions predominate as the 
format used in standardized reading comprehension tests? In an ex- 
amination of the literature from the early ytars of this century, 
Readence and Moore (1983) illustrated how early test designers 
concentrated on objective x convenient measures of comprehen- 
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sion at the expense of providing a more complete picture of students 
comprehending abilities and how this led to the predominant use of 
questions today. 

Three types of comprehension test formats emerged from this 
examination: reproducing a passage, solving written puzzles, and 
answering questions. Passage reproduction was advocated by 
Starch, who felt that comprehension should be determined by the 
most simple, rapid, and objective means possible and suggested that 
a count of the written words that correctly express the thought of a 
passage would accomplish ihis. He asked students to read passages 
on two consecutive days and to recall what they had read. Compre- 
hension was determined by "counting the number of words written 
which correctly reproduce the thought. The written account is care- 
fully read, and all words which either reproduce the ideas of the test 
passage incorrectly or add ideas not in the test passage or repeat 
ideas previously recorded are crossed out. The remaining words are 
counted and used as the index of comprehension" (Starch, 1915, p. 
7). 

Th: phrase "correctly reproduce the thought" unfortunately 
meant verbatim reproduction to Starch. Thus, comprehension was 
measured b> students' ability to recall a passage exactly; inferences 
and synonym substitutions were discounted. 

Although Starch felt his test was simple, rapid, and objective, 
other researchers did not. Reproducing a passage was criticized as 
impractical due to the time involved in scoring (Kallom, 1920), in- 
valid because of low correlations to other measures of comprehen- 
sion (Gates, 1921), and inappropriate because ihcr^ was a question 
as to whether this task actually reflected students' abilities to com- 
prehend that passage (Monroe, DeVoss, & Kelly, 1917). 

In response to the objections to the reproduction format, 
Kelly (191 6) developed the Kansas Reading Test that required sim- 
ple responses to short paragraphs. Students were given five minutes 
to respond to sixteen exercises at the appropriate test level. Below 
are two sample test items from the test for grades three tiirough five. 

3. Three words are given below. One of them has been left 
out of the sentence: I cannot the i^rl who has 
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the flag. Draw a line around the word which is needed in 
the above sentence. 

red see come 

16. If in the following words e comes right after a. more 
times than e comes just after then put a Ime under 
each word contaiaing an e and an but if e comes just 
before a more often than right after /, then put a line 
under each word containing an a and an e. 

receive feather 
teacher believe 

This test format required reasoning similar to that of solving 
puzzles and demanded that students follow directions exactly. For 
instance, if in the first example, the student underlined (and did not 
circle) the correct response "see," the exercise would be counted as 
incorrect -comprehension failure was assumed. 

This puzzle format was criticised by researchers of the day. 
Starch (1916) and Monroe, DeVoss, and Kelly (1917) felt the tasks 
assessed only a narrow band of comprehending behavior and did not 
represent normal reading situations. Gray (1917) said puzzle for- 
mats did not allow for varying degrees of comprehension; he felt it 
unjust to mark something incorrect when it was obvious the student 
understood the task but did not follow directions explicitly. 

The third major compiehension test foimat was proposed by 
Thorndike (1914, p. 207), who saw the need for "more objective, 
more accurate, and more convenient measures of . .a pupil's abil- 
ity to understand the meaning of words and sentences seen." To this 
end, Thorndike developed the Scale Alpha, which cv iisisted of a se- 
ries of short paragraphs and quebttons of increasing difficulty. Stu- 
dents were asked to read the passages and write answers to the 
questions that accompanied them. No time limit was imposed. 

Following is an example of a paragraph and its questions 
from Scale Alpha (pp. 251-252). As you will note, question four is 
closely akin to the word puzzle format and has nothing to do with 
ihe paragraph. 

SetC 

Read this and then write the answers. Read it again as often 
as you need to. 
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It may seem at first thought that every boy and girl who 
goes to school ought to do all the work the teacher wishes 
done. But sometimes other duties prevent even the best Doy 
or girl from doing so. If a boy's or girl's father died atid he 
had to work afternoons and evenings to earn money to help 
his mother, such might be the case. A good girl might let 
her lessons go undone in order to help her mother by taking 
care of the baby. 

1 . What are some conditions that might even make the best 
boy leave school work unfinished? 

2. What might a boy do in the cvei ings to help his family? 

3. How could a girl be of use to her .nothcr? 

4. Look at these words: idle tribe inch it ice ivy tide true tip 
top tit tat toe. Cross out every one of them that has an / 
and has not any / in it. 



Gray (1917, p. 7) observed that "the scale fulfills the stand- 
ards of objectivity, definiteness, exactitude, and convenience.'' This 
formal could be given and scored quickly and impartially, overcom- 
ing many of the objections of the reproduction and puzzle formats. 

The question format was not without its detractors. In the 
same writin<», Gray pointed out that the test measured only a limite(^ 
aspect of students ability to comprehend text. Shank (1930, p. 129) 
stated that tests employing the question format asked the student to 
"write his response to a question whose answer may be found di- 
rectly in the content.'' Tuinman (1973) pointed out that questions 
may uol be passage dependent; students might be able to answer the 
questions without reading the passage. Thus, it can be surmised that 
this format does not always measure students' true comprehending 
abilities. 

By 1930 the question format became the predominant means 
of assessing comprehensit^n and the prototype for current standard- 
ized tests of reading comprehension. Educators felt that answering 
questions offered the most convenient, economical, and objective 
tu«" jt for comprehension assessment. The popularity of this format 
wa^ further enhanced by the fact that questions were adaptable to the 
multiple choice formats popular in the 1930s and to computerized 
scoring in the 1960s. 
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Yet, the question format does reprcjont a compromise on the 
part of educators. In gaining convenience and objectivity, educators 
gave up obtaining a more completr * Mure of students' comprehend- 
ing abilities. Numerous educators feel that students ability to com- 
prehend is muitifaceted and that reliance on a single measure of this 
complex construct is unwarranted (Carroll, 1972; Dc ..y, 1934; Pe- 
trosky, 1982; Pressey & Pressey, 1921). 

Standardized reaoing comprehension tests may help sort stu- 
dents and compare groups ^^ccofding to rough measures of general 
academic abilities, but these tests provide only limited information 
about the specific comprehending abilities of students. As a result 
there is not sufficient diagnostic information to allow teachers to 
plan instruction. Teachers require the results of other informal and 
observational measures of comprehension to obtain more complete 
pictures of students comprehension abilities and to use that infor- 
mation to plan for appropriate instruction. 

Informal Comprehension Mea.sures 

Since comprehension is essentially an internal, unobservable 
phenomenon, we can gauge only behaviors that reflect it. Thus, the 
more methods used, the better the chance teachers have of making 
valid assessments (Johnston, i984). While there are numerous in- 
formal measures that can be used to build a picture of students com- 
prehending abilities, we advocate ihe u.se of measures relevant to 
what students are reading and learning; about in their classrooms; 
i.e., ecologically valid measures of students as they are interacting 
with relevant reading task' and situations in their basal readers and 
content textbooks. 

While we acknowledge that additional diagnostic information 
can be gained about students* comprehending abilities through other 
assessment measures -such as a published informal reading inven- 
tory -the reading tasks students are asked to perform deal with con- 
trived text and not with naturally occurring text used daily in 
classroom reauing assignments. We would recommend that if teach- 
ers weie to use an informal reading inventory to gather the most 
relevant diagnostic information possible, the inventory should be 
designed to use pas.sages from the textbooks .students u.se. 
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While w?. lave stated that a question format does assess only 
limited aspects of students* comprehension, questions can help 
gather a more complete picture of their abilities. Questions can be 
designed to examine how well students can cope with the new vo- 
cabulary of a textbook, to examine how well students can internalize 
the ideas of the basal or textbook by asking questions that go beyond 
the facts stated in them (i.e., questions at the text implicit or experi- 
ence based levels of comprehension), and to see how well students 
'x)pe with the various book parts (e.g., table of contents, index) 
available to aid them in the reading/learning process. 

Teachers can then go beyond what they learn from asking 
questions by engaging students in other types of assessment mea- 
sures. For example, students can be asked to read orally a passage 
from their textbook, and teachers can examine the miscues students 
make as they try to understand what they read. In this way, miscues 
provide an ongoing process measure that goes beyond questions id 
asks "Av '*^e student comprehending?" rather thar. "WItat is the stu- 
dent com^ichending?" (Allen & Watson, 1976). Students could be 
asked to react in writing to a narrative passage to see whether they 
are attending mainl> to surface level plot structures, character devel- 
opment, or underlying universal themes (Purves, 1968). The above 
mentioned mcusures of comprehension, plus those mentioned ear- 
lier in this chapter as alternatives to asking questions, are all appro- 
priate for obtaining more complete pictures of students' abilities to 
understand what they read. The next section of this chapter adds 
more information to those pictures. 

Diagnosis by Observation 

Most traditional forms of assessment measure a student's per- 
^'^rniance at that point in time only. Additionally, the administration 
of traditional assessment measures on a one time basis does not pro- 
vide sufficient information for drawing conclusions about students' 
abilities because (as previously discussed) most focus on a narrow 
set of comprehending behaviors. Teachers need additional informa- 
tion gained from muhiple measures administered -periodically to ob- 
t;Mn updated information. This does not mean administering more of 
the same types of tests; it requires teachers to be more sens* >^ to 
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the entire instructional situation and the major variables involved in 
it. Teachers need to be concerned with the reader, the text, the task 
required of the reader, and the actual processes needed to complete 
the task (Readence, Bean, & Baldwin, 1985). Assessment needs to 
be conducted as students interact with text and complete daily class- 
room assignments. 

Actual classroom reading assignments can provide many 
good sources of diagnostic information lh^\ cannot be gained 
through traditional assessment. Specifically, teachers need to make 
a conscious effort to observe and st» d> their students at work in 
several classroom settings (see Glazer & Searfoss, this volume). 
Moore (1983) referred to this as naturalistic assessment because it 
requires teachers to observe students' responses to naturally occur- 
ring classroom activities instead of to more contrived testing situa- 
tions. Te_chers observe students as they participate in a variety of 
circumstances over a period of lime and try to identify patterns of 
behavior that may represent difficulty in some area. These patterns 
are then interpreted and used to reach conclusions regarding stu- 
dents' strengths and weaknesses. This information then can be 
added to and compared with that gained from more traditional as- 
sessment devices. 

Naturalistic procedures, or observations, may be the most 
valid and reliable means of assessing reading comprehension 
(Moore, 1983). Their validity is strong because daily observations 
occur as a natural part of the lesson; teachers view students' re- 
sponses in an objective, unbiased manner; and the observations are 
conducted in the natural context of real reading (Cunninghj^.n, 
1982). This allows the teacher to assess what students have learned 
rnd to observe how well students apply what they have learned as 
they read. 

High reli'^^ii;*y is achieved because of the nature of observa- 
tional assessniehi. Specifically, because teachers base their conclu- 
sions on .iumerous observations over a period of time, they avoid an 
essential problem of more traditional assessment measures -lack of 
consistency. The observed patterns that lead to the conclusions are 
patterns thit have occurred frequently in real reading situations and 
not in contrived testing situations. Finally, o^^servations are 
planned, structured, and systematic (Cunningham, 1982). 
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The use of observations as a means of comprehension^ '\ssess- 
ment presents a viable alternative to traditional assessment deviceb. 
The most important aspect of this approach revolves around the idea 
that assessment is ongoing and conducted within the context of nor- 
mal classroom activities while real reading is taking place. We will 
now present a model of direct instruction in which the use of obser- 
vational assessment can be integrated and discuss examples of some 
specific strategies that lend themselves to this type of assessment. 

Direct Instruction. During the late 1960s and the 1970s, de- 
velopmental psychologists investigated possible effects of instruc- 
tional intervention upon reaJing comprehension As a result, 
numerous research studies in the late 1970s and early 1980s were 
conducted for the specific purpose of determining the instructional 
characteristics of effective reading comprehension instruction. The 
question governing these pursuits was, "Can students be made aware 
of reading comprehension strategies or be taught skills that v/ould 
transfer to independent reading situations?" (Tierney, Readence, & 
Dishner, 1985, p. 84). The conctj:i of explicit teaching of reading 
comprehension, or direct instruction, emerged from these research 
studies. 

The features constituting direct instruction have been ad- 
dressed by numerous researchers of reading comprehension (e.g., 
Palincsar & Brown, 1983; Pearson & Gallagher, 1983; Tierney t 
Cunningham, 1984). In their 1985 text, Tierney, Readence, and 
Dishner (1985, p. 85) described those features in the following 
manner: 

1 . Relevance. Students are made aware of the purpose of the 
skill or strategy. 

2. Definition. Students are informed as to how to apply the 
skills by making public the skill or strategy. 

3. Guided Practice. Students are given feedback on their own 
use of the skill strategy. 

4. Self-regulation. Students are given opportunities to try out 
the strategy themselves and develop ways to monitor their 
own use of the skill or strr^'^gy. 

5. Gradual Release of Responsibility. The teacher initially 
models and directs the students' learning. As the lesson 
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progresses, the ieacher gradually gives more responsibility 
to the students. 

6. Application. Students are given the opportunity to try their 
skills and strategies in independent learning situations, in- 
cluding nonschool tasks. 

Additionally, the implementation of a direct instruction les- 
son calls for teachers to follow certain guidelines that help them as- 
similate the important features of direct instruction into the lesson. 
What follows is a presentation of the specific guidelines and exam- 
ples of possible questions/statements teachers could use if they were 
attempting to teach main id . comprehension in a family living 
class. 

1. Introduce the skill or strategy by providing examples of 
what you ar-^ teaching and by relating the examples to the 
students' piior knowledge. In addition to tapping prior 
knowledge, ihis step also establishes the purpose of the 
strategy. For example, asking the following would be use- 
ful. **Have you ever been on a blind date? Kow did you 
find out what the person you were dating was like? Imag- 
ine you have gotten a friend a blind date. You have to tell 
your friend the most important features of the person she 
or he will be going ou* with. How would you do this?'' 

2. The next stage involves teachers in labeling, modeling, de- 
fining, and explaining the skill or strategy. The how, 
when, and ;vhere of the strategy is presented through neg- 
ative and positive examples. For example, teachers ex- 
plain that students are going to learn more about hiain 
ideas. The students are instructed to icad a stcry in which 
Bob is telling Dave about the blind date he har for the 
Spring Formal Afterwards, teachers discuss how ihey 
would select the main idea and important facts in the story. 
The teacher and students read through another example 
sioiy to provide guided practice. For example, a story to 
tlnd out about Mike's blind date for the Spring Formal. 

4. Students are provided independent practice through the use 
of a checklist or reading guide. For example they read a 
story (0 find cut about Sally's blind date for the Spring 
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Formal and to deci^ whether the main idea of Sally's 
story is what Sally does on her date, what Sally's blind 
date wants to do on their date, or what Sally s blind date is 
really like. Advise students to identify the most important 
facts and ideas. Students discuss their decisions. 

5. The final stage involves independent application by th^ 
students. For example, the teacher suggests the students 
apply their skills/strategies to a fourth story about Bill's 
experiences wi*h his blind date at the Spring Formal. After 
a discussion of this application, student^ ^ive examples of 
how they could use this skill in other classes. 

Through the application of direct instruction, students will 
learn how to independently apply the Aills/strategies identified as 
essential to successful comprehension. In addition, teachers are able 
to teach these specific skills/strategies through direct instruction 
and, as teaching occurs, are able to successfully assess (through ob- 
servation) their students' learning. For instance, in this lesso.i, 
teachers can observe whether students grasp the purpose of getting 
the main idea of a passage; understand how to get the main idea; can 
apply what they have been taught before and after reteaching; are 
able to verbalize their thinking about how they derived the main 
idea; and can inaependently derive main ideas from other texts. 

Specific Comprehension Strategies. As stated earlier, one of 
the benefits of observational assessment is that assessment occurs as 
students ::re involved with instructional activities in the actual con- 
text of their classrooms. Through the use of a direct instruction ap- 
proacn, teachers are able to observe their students' appMcations 3f 
skills/strategies. However, there aie additional comprehension strat- 
egies that lend themselves to observational assessment. In this sec- 
tic .1, the anticipation guide and the guided reading procedure will be 
discussed. 

Anticipation Guides. A.i anticipation guide (Readence, Bean, 
& Baldwin, 1985) attempts to enhance students' comprehension 
through the activation of their prior knowledge. Through the use of 
controversial statements, students are motivated to become involved 
with the material th^y are about to read. 
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Anticipation guides can be used as an assessment measure. 
As students react to the statements, teachers can observe how much 
students know about a topic. The guides also allow teachers to ob- 
seive how well students intera:t with one another as they attempt to 
make predictions concerning a topic. Teachers can observe how 
well students pose their own questions, anticipate what is to come in 
the text, and justify their responses to guide statements. Finally, 
teachers can observe how well students recognize and reconcile 
prior knowledge inaccuracies when they encounter them in reading. 

Guided Reading Procedure (grp). The grp was developed by 
Manzo (1975) to provide teachers with a series of instructional steps 
that would assist students with material being rea^ in the classroom. 
Specifically, the grp was designed to assist students recall of infor- 
mation, improve students abilities to create their own implicit ques- 
tions during reading, develop students understanding of the 
importance of self-correction, and improve students abilities to or- 
ganize information (Tierney, Readcnce, & Dishner, 1985). 

As teachers guide their students through the ^arious stages of 
the GRP, they can observe their interactions with the material. 
Teachers can observe and judge the quality of their students recall 
information after reading. For those students who need additional 
assistance in this area, teachers can refocus attention on missing in- 
formation and stddents efforts to ask questions to fill in gaps in re- 
call. Additionally, it can be noted which students have trouble 
organizing the recalls, and further instruct! ^n can be planned to deal 
with these problems. 

Summary 

In this chapter we have traced the development of standard- 
ized reading comprehension tests to demonstrate that obtaining a 
more complete pi'^ture of students comprehending abilities has been 
sacrificed for the sake of convenience and objectivity. Because little 
useful diagnostic information can be attained from these measures, 
teachers need alternative measures of students abilities. We have 
recommended that this information be obtained by using more eco- 
logically valid measures of comprehensior . Discussions have been 
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provided of possible informal measure^ of comprehension that can 
give teachers multiple sources of information. The additional use of 
observafton by tearhers as they interact with their students can be 
very heipful in developing more complete pictures of students' com- 
prehending abilities. Finally, examples were provided of the kinds of 
diagnostic information teachers can obtain through observation 
when in the actual course of comprehension instruction . it is our 
hope the information provided here will do what we had intended- 
provide teachers with some viable and useful alternatives in reading 
comprehension assessment. 
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Measuring Comprehension: 
Alternative Diagnostic Approaches 



This chapter describes informal procedures that can be used to 
diagnose the abilities of students to recall information derived 
from print. The methods presented are alternatives to the traditional 
question-answer format. Strategies are presented to help students 
organize for more effective recall as well as provide ongoing diag- 
nostic information for the teacher. Factors ^re discussed that affect 
students* understanding of text and their ability to a.similate new in- 
formation into existing schemata. 

Case studies of disabled readers are replete with test results 
and anecdotal records that report the difficulty these students have 
remembering information they have read. The causes for their lim- 
ited recall often are not ascertained; consequently, the instruction 
they receive in classrooms and r<"source rooms may not address def- 
icit areas. Instead, traditional teaching procedures that focus on 
reading and questioning are followed, ft^chers may adhere to this 
conventional method because school records lack specificity in 
identifying academic deficits. Both formal and informal test re^alts 
can mask weaknesses in comprehending and recalling written text. 
Although students may attain similar achievement levels on a test, 
there may be significant differences in their abilities to organize and 
freely recall information contained in re jing selections. Students 
of all ages must .^arn to assimilate new knowledge in a classification 
system and recall it without the aid of teacher generated questions. 
Assessments of reading competency should include procedures that 
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will yield information about r.call without the aid of questions, 
along with specifics about the structure of the recall. 

Major Factors Affecting Comprehension 

The assessment of comprehension demands an awareness of 
various elc nents that contribute to effective understanding of writ- 
ten text, including prior knowledge, linguistic competence, nem- 
ory, and schemata. Each plays a crucial role in the way readers 
comprehend printed materials and organize important ideas so they 
can be retrieved at anoth'^r time. 

According, to Johnston and Pearson (1982), prior knowledge 
influences the comprehension process at all levels. It aids the reader 
in selecting words that will fit the context of a sentence, determines 
the amount of ir/ormation that can be stored in both short term and 
long term memory, decides the form in which it will be stored, and 
plays a decisive role in helping an individual make inferences. 

Studies have shown that linguistic competence is related to 
successful reading (Rdmiaston, 1985; Laine, 1978). Students must 
have language labels for experiences so they can expand tneir vocabu- 
laries and better understand written text. The syntax of reading selec- 
tions should be familiar to them so understanding is facilitated. 
Furthermore, they must be able to combine sounds into words. All of 
these linguistic factors contribute to successful reading. 
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Teachers are aware of the role memory plays in the corripre- 
hension process. Prior knowledge rests on the endurance of mem- 
ory. Many psychologists believe that information is stored and 
retrieved on the basis of meaning (Baron, Byrne, & Kantowitz, 
1977). In other words, knowledge is assimilated in one's memory in 
some type of organized structure governed by meaningful categori- 
zation. Readers have stored in long term memory general knowl- 
edge about the worid and knowledge specific to their lives. Both 
types of knowledge affect their comprehension of textual material. 

Schema theory attempts to explain the way that knowledge is 
stored in memory. Information about a particular topic is organized 
in a cognitive framev\ork called a schema. Each schema represents 
knowledge of a particular concept and is related to othei schemata in 
tne hierarchy. Theorists believe the interrelationships among sche- 
mata help readers understand written text and affect the v/ay mate- 
rial is recalled from memory (Adams & Collins, 1985). Rumelhait 
(1984) suggests that readers may fail to comprehend because they 
do not have appropriate schemata, the author may not have provided 
sufficient clues to suggest a specific schema, or the reader and 
writer might not share the same schemata. 

When evaluating students' performances on tests or in diag- 
nostic activities, the influence of their experiential backgrounds 
should be considered. La^iguage variables, within the reader and 
within the text, need to be examined when learners have difficulty 
comprehending. Furthermore, the type of memory demanded in an 
assessment should be noted. Since information is stored and re- 
trieved on the basis of meaning, an understanding of schema theory 
may help a teacher design informal procedures that evaluate reten- 
tion of concepts over a period of time. The rest of this chapter will 
describe procedure that can be used to evaluate students abiMties to 
organize and retain important information in ongoing diagnostic 
♦caching. 

Assessing Recall of Written Information 

Most individually administered reading tests require students 
to answer questions after reading a paragraph orally or silently. An 
instructional level is ascertained bared on the number of correct re- 
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sponses and the number of words pronounced accurately. Diiccted 
reading lessons also follow a question-answer format. The main 
benefit derived from using this procedure is a major limitaiion in 
assessing anr^ developing comprehension skills. Askinj. questions 
helps studenib remember significant ideas and details; however, al- 
most every d,^y we must recall information gained through print 
without the aid of questions. Thus, conclusions about an individuals 
reading ability basea solely on postreading questions could be m.' 
leading and miniir.illy helpful in planning relevant instruction. A 
diagnostic procedure that combines tree and aided recall might 
more accurately e^nluate comprehension ability. 

The case studies of two boys, Steven and Jerry, clearly illus- 
trate the limitations inherent in traditional evaluation procedures. 
School records based on informal reading inventories indicated that 
the boys achievement levels in reading were similar. Scores used to 
determine the levels were based on responses to questions asked af- 
ter reading (aided recall). When reading orally, Steven hesitated fre- 
quently and mispronounced and repeated words; mispronunciation 
errors were usually detected and corrected. In contrast, Jerry was a 
fluent oral reader and was being instructed at a higher level than 
Steven. Teachers were puzzled by the boys' responses to instruction. 
Steven usually provided more accurate and thoughtful responses in 
both reading and content subject lessons. Testing helped to explain 
some of the incongruities teachers found perplexing. By first assess- 
ing each boys retelling ability (unaided recall) and then asking 
questions, teachers obtained a more exact description of their com- 
petencies. Figure 1 presents ihe comprehension scores the boys at- 
tained after reading a paragraph at the third grade reading level. 

At this level and all others, Steven s retellings were more in- 
clusive and more accurately sequenced than Jerrys. However, when 
questions were used to help the boys remember decails from the par- 
agraphs, their scores were remarkably similar. A comparison be- 
tween these two aspects of comprehension pointed out the necessity 
for teaching Jerry strategies that might develop his ability to recall 
more of the important content and sequence. 

Retelling has been used as an assessment tool in many re- 
search studies (Gambrell, Pfeiffen & Wilson, 1985; Irwin & Mitch- 
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Figure 1 
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ell, 1983; Stein & Glenn, 1979). Irwin and Mitchell found flaws in 
a strictly quantitative analysis of retellings and suggested attention 
be given to both quantitative and qualitative analyses. Thus, when 
retelling is used for assessment purposes or for instruction, teachers 
should identify important elements in narrative or expository selec- 
tions before asking s^Uv *o read them. Then, during the retell- 
ing, teachers can readi. ,rmine the extent to which students can 
recall important detail, .s a postretelling activity, teachers can ask 
questions to elicit details not included in the retelling. The questions 
may draw attention to certain story elements that are consistently 
overlooked by readers and indicate an area for instruction. So, re- 
telling can be simultaneously a diagnostic technique and an instruc- 
tional method. 

Depending upon the ages and abilities of students, details 
may be recalled orally or in writing. Reading important points either 
in words or phrases seems to help many disabled readers recall in- 
formation in sequence, besides providing graphic evidence of 
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Figure 2 

Percentages of Important Details Recalled 




achieve .nenl. The number of details remembered may t * noted on a 
cumulative chart used over a period of time; thus, some students 
observe that progress is steady and consistent while others become 
aware of the peaks and valleys in their learning pattern. One fen year 
old boy likened the charting of memories to keeping score in a 
sporting activity, so it was highly motivational. His chart reflected 
inconsistency (Figure 2) and prompted him to say, "Sometimes I do 
good and the next time I don't." 



Assessing Organization for Recall 

Reading achievement ricy be evaluated in a single session or 
over a period of lime. Although the latter is more desirable, some- 
times circumstances dictate testing in one session. The diagnostic 
findings from sucl a session are tentative, and competencies may 
change. Thus, ongoing diagnostic teaching, based on recommenda- 
tions, becomes an avenue for furthei evaluation (GIdzer u Searfoss, 
198S). Insights into students strengths and needs come wi^h e^ch 
new lesson. This continuous flow of information enriches (he »^valu- 
ation process and makes it more accurate. 
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Figure 3 
Story Frame for Plot 



In this story the problem starts whc . After that. 

. Next. 

. The problem is 

finally solved when The story ends 



Instructional strategics can provide guidance in recalling and 
organizing information and also yield evaluative data. Understand- 
ing and recall of text can be assessed by examining the way a story 
or outline frame is completed. Sentence combining exercises pro- 
vide insights into language proficiency at the sentence and para- 
graph levels. Formats such as question-answer-details and outline 
framcv: test Drganizational skills and the ability to perceive relation- 
ships between important ideas and supporting details. The ^st of 
this chapter focuses on the use of story frames, sentence combining, 
QAD formats, and outline frames in ongoing diagnostic teaching. ' 

Sfory Frames 

A story frame is a series of spaces linked by key language 
elements that often are transition words and reflect a particular line 
of thought. A frame may refer to the plot, setting, theme, or charac- 
ters of a story. After reading a story, students complete a frame 
about it. Figure 3 illustrates a frame relating to the plot cf a story. 

According to Nichols (1980) an-* Fo' (1982), story frames 
provide a stru -ure that helps low achie. _ ^ readers organize inibr- 
niation so they can identify important points, analyze characters and 
their problems, make comparisons, and summarize the content of 
passages. Frames are particularly helpful for students who are not 
proficient in writing. 

Story frames can provide insights about oral and silent read- 
ing ability, memory for details, prior knowledge, and understanding 
of syntax. Some disabled readers may need to reread parts of a story 
orally in order to complete a frame. The teacher may have to direct 
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students' attention in the story to specific sentences that supply in- 
formation required for a response. At first, use stories that are easy 
and of interest to the reader. Over a period of time, however, oral 
rereading as well as specific directions from the teacher should be 
eliminated and the reading level of the story increased. 

Analysis of a completed frame can furnish information about 
prior knowledge and the extent to which it enhances understanding 
or acts as a deterent to it. A student who was an avid television 
viewer often used knowledge gained from this medium to camou- 
flage his inability *o recall information. The deception became ap- 
parent when he completed modified story frames constructed for 
expository reading selections. Inadequate comprehension skills of- 
ten are not detected in the elementary grades; students' experiential 
backgrounds help them to make reasonable, but not accurate, re- 
sponses to postreading questions. 

A reader's syntactical knowledge can be assessed in a limited 
way by using story frames. Students must understand and be able to 
produce basic sentence pa.terns as well as those that have been al- 
tered and expanded by ciauses and phrases. Continuous observation 
may reveal deficiencies in specific areas. For one student, it was 
clear after completing four or five frames that she did not produce 
complete prepositional phras.^s. For instance, she would write 
"Some animals live on land and others live in sea." Examination of 
story frames led to the recognition of this deficiency in both written 
and oral language. 

Through careful scrutiny of a few story frames, teachers and 
diagnosticians can discover instructional needs that might not ap- 
pear in traditional testing situations. The frames that yield these di- 
agnostic insights also help readers understand and organize 
information. 

Sentence Combining 

Sentence combining is a technique frequently used to in- 
crease syntactic flue.xy in writing. At first, students are taught to 
combine simple kernel sentences into a fairly simple sentence. 
Later, they learn to make more complex combinations. Lefevre 
(1970) believes that reading comprehension can be improved when 
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the sentence is emphasized as the basic meaning bearing unit instead 
of the word. Research conducted by Frose and Kurushima (1979) 
supports the value of teaching sentence combining. They found that 
the abilities of third grade children to understand syntactically com- 
plex sentences improved after receiving instruction in this tech- 
nique. Neville and Searls (1985) found that sentence combining and 
kernel identification exercises helped sixth grade students to recall 
syntactically complex text. Strong (1976) suggests that sentence 
combining is a powerful approach because it teaches students to re- 
tain longer discourse in their memories. 

When readers have difficulty comprehending written lan- 
guage, their understanding of sentences should be assessed. Exer- 
cises in sentence combining may be both diagnostic and 
instructional. Students can be presented with two kernel sentences 
and told to merge them into one. Being able to read the sentences 
but not able to combine them may be an indication that expanded 
sentences are not part of their oral language. Instruction probably 
should focus on developing this skill. Frose and Kurushima found 
that students understood passages written at their productive lan- 
guage level but had difficulty comprehending above that level. 

Evaluation should not be limited to combining two kernel 
sentences. Intermediate and secondary level textbooks require un- 
derstanding of complex sentences. Thus, ability to combine ex- 
panded sentences and to use conjunctions and pronouns should be 
assessed. Given a list of pronouns, students might be asked to com- 
bine "She looked at the boy'' with "The boy came out of the gray 
house." 

Educators generally agree that productive language ability is 
basic to reading comprehension. However, children tend to be mys- 
terious, unpredictable creatures. One boy could recall most of the 
important points in a reading selection despite the fact that his oral 
expression was restricted. When tested, he was unable to combine 
simple sentences. After a few instructional sessions, he understood 
the procedure for merging two or three closely related kernel sen- 
tences. Ongoing diagnostic teaching showed a need for further in- 
struction in producing more complex sentences. So a single lesson 
in sentence combining may reveal important language deficiencies, 
even when comprehension is satisfactory. 
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Figure 4 

QAD Chart 


Question 


Answer 


Detail 


What do we call the place 
thai is the farthest north 
on earth? 




UAAJULCuUikt 


What would you find at 
this place? 






Who was the first person 
to reach this place? 







QAD Formats 

Question-answer-detail charts require students to provide de- 
tails that support their answers to specific questions. In preparing a 
QAD, students formulate questions about important points in a story. 
After reading the selection, students write answers to the questions 
along with supporting details, without referring to the story. Figure 
4 presents an example of a qad chart. This technique has been used 
successfully in schools that employ the Individualized Language 
Arts Program (1974).. 

An inability to answer questions on a qad chart can indicate 
inadequate retention. Responses may be logical but derived from ex- 
periences rather than from the story. Some readers will answer 
questions quickly and accurately but have difficulty supplying de- 
tails; they are unable to justify their responses. Since the purpose of 
a QAD is to elicit replies congruent with the text, students may need 
to refer to the story in order to complete the chart. A teacher may 
have to ask probing questions to guide their thinking. However, the 
main reason for using qad strategy is to help students organize in- 
formation and develop retention; thus, they should be weaned from 
the practice of referring to the story. 

QAD formats provide diagnostic data about students' compre- 
hension, retention, and understanding of relationships among details 
in a story. The charts provide an organizational structure that facili- 
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tates recall. According to schema theory, this type of structure is 
necessary for the storage and retrieval of information (Adams & 
Collins, 1986). Additionally, the technique fosters metacognitive 
thinking strategies because readers justify answers when they sup- 
ply supporting details. 

Outline Frames 

Many students have difficulty dealing with the structure and 
organization of expository text (Meyer, Brandt, & Bluth, 1980; Tay- 
lor, 1980). They may not recognize a main idea and realize that it is 
supported by details or examples. Consequently, recall after reading 
might consist solely of irrelevant or unconnected facts. Taylor 
(1982) found the hierarchical summary procedure helpful in direct- 
ing middlegrade students' attention to the organization of ideas in 
content textbooks and in increasing the amount of information re- 
membered after reading. 

In the first step of the hierarchical summary procedure, with 
the aid of a teacher, students generate a skeleton outline for a seg- 
ment of a textbook. Roman numerals and capital letters are used to 
designate major sections and subsections. Five or six lines are left 
between capital letters so students can write important supporting 
details as they read. After reading, the details are discussed and, 
with the teacher's help, a main idea and a few important supporting 
details are identified. Finally, students study the material and retell 
orally what they have learned. 

A modification of the hierarchical summary procedure can be 
used as an assessment device. Students are presented with a skeleton 
outline that contains the major headings and subheadings from a 
reading selection and told to complete the outline while reading the 
passage. Words or phrases supplied indicate clearly whether the stu- 
dent can recognize supporting details. Variations of this procedure 
call for skeleton outlines in which details are given but subheadings 
are not provided. The latter variation is not suggested for elemen- 
tary school children; however, it has been helpful in diagnosing the 
reading difficulties of high school students. 

The hierarchical su ^nmary procedure was developed to be an 
instructional method. Like all good teaching strategies, it can be- 
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come an assessment tool when the students' learning behaviors are 
carefully observed. When this tool is used over a period of time, 
teachers may get a more accurate assessment of students' abilities 
than they would secure from a single reading test. A seventh grade 
girl named Cara exemplifies the necessity for going beyond the test. 
Although test results indicated that she could read at the eighth 
grade level, Cara was receiving below average grades. When pre- 
sented with a skeleton outline, she completed it satisfactorily. How- 
ever, in future sessions, when Cara was asked to develop an outline, 
she was not able to do it This inability to recognize and organize 
important information pi evented her from taking relevant notes and 
summarizing reading selections. Thus, her achievement in content 
subjects was unsatisfactory. 

The completion of outlines is an activity suitable for single 
session testing as Vvcll as ongoing diagnostic teaching. Over a period 
of time, teachers get an accurate assessment of students' abilities to 
recognize main ideas and supporting details, to scan and skim mate- 
rials in order to locate specific information, and to sequence facts 
and events. 

Sum^iiary 

This chapter emphasizes the importance of reaching beyond 
traditional test scores foi diagnostic information. Since human be- 
ings tend to be unpredictable, informal procedures that can be used 
in ongoing diagnostic teaching often yield more accurate informa- 
tion about a student's reading ability than tests used in a single test- 
ing session. In addition to >::lding evaluative advice, the strategies 
described in this chapter can help students formulate a structure for 
assimilating and retaining the important information they derive 
from print. 
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Merging Assessment and Instruction: 
Protocols in the Classroom 



Assessment and instruction in reading typically occur as sepa- 
rate activities in school. The two often are assumed to have 
different goals and audiences, to require distinct methods, and to 
use different materials. The task of assessing may fall to specialists 
who work ou .ide classrooms, so teachers have difficulty using the 
findings to make instructional decisions. In many cases, assessing 
and teaching are the responsibility of different staff members within 
a school system, so the reading specialist or school psychologist 
may be responsible for assessment while the classroom teacher is in 
charge of instruction. Yet much can be achieved from integrating 
these two activities: Teachers can gather data systematically while 
teaching and students can self-assess actively while learning. Teach- 
ers can respond immediately to the data gathered while students be- 
come informed partners in their learning. 

This chapter argues for the importance of integrating assess- 
ment and instruction in reading and for using think aloud protocols 
in teaching. Protocols focus teachers' and students' attention on the 
processes of learning, thus providing information about students' 
metacognitive behaviors before, during, and after reading. They can 
be used as a structure for whole class or small group activities as 
well as a framework for thinking or writing about what has been 
read. 

Why Integrate Assessment? 

Although school structures typically maintain distinctions be- 
tween assessment and instruction in reading, there are theoretical 
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Reasons 
for integrating 
assessment 

Theoretical 
Practical 



Reading 
protocols 



Definition 
Use in research 



Using protocols in 
the class^oopfi 



and practical reasons for not doing so. Current theories of reading 
describe the processes of gaining meaning from print as a construc- 
tive activity in which the reader gradually builds an understanding 
of the text (Collins, Brown, & Larkin, 1980; Rummelhart, 1977; 
Spiro, 1980). This process is dynamic, with readers continuing to 
formulate meaning throughout the entire task and often revising 
their interpretations through rereading, rethinking, or writing about 
what has been read. Although teachers' questions after reading may 
be viewed as assessment within instruction, one could argue that 
this focus on products gives teachers and students little insight into 
how the learners arrived at the answers. 

A second theoretical perspective supporting the integration of 
assessment and instruction emphasizes the contextual nature of 
reading. We know from sociolinguistic research that home, school, 
and community contexts demand a variety of functions and uses for 
reading, and thus a diverse set of tasks and strategies (e.g., Bloome 
& Green, 1984).: In school, ( ombining assessment with instruction 
makes it more likely that the information gained from the assess- 
ment will be ecologically valid. Instead of testing reading, protocols 
can be used to assess readers' processes in context, within naturally 
occurring reading tasks. 

From a practical perspective, separating assessment from in- 
struction creates problems for classroom teachers who lack the time 
to do frequent, in depth assessments of individual students. Al- 
though group assessments of prior knowledge and progress are es- 
sential for planning lessons, information often is not obtained on 
readers' processes of comprehension. If teachers had the informa- 
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tion, they could use it to direct a lesson in progress or help in plan- 
ning for future work. 

Think Aloud Reading Protocols 

Think aloud protocols provide a means for gathering infor- 
mation about individual readers' ongoing thinking processes and 
metacognitive behavior. Used flexibly, protocols can provide a 
framework for assessment integrated with instruction. We are defin- 
ing think aloud reading protocols as verbalizations of a reader's 
thoughts before, during, and after reading. To assess comprehension 
in process, readers are asked to read a portion of text and then to 
voice their thoughts. Directions asking readers to report such 
thoughts as "news bulletins or play by play accounts of where you 
are intellectually as you figure out what the reading is about" (Lytle, 
1982, p. 113) may be used to help readers understand what they 
might talk about. 

Origins of the use of various think aloud procedures to study 
reading can be traced back to Huey's 1908 use of retrospection and 
introspection to study college students understanding of vocabulary 
words. Since then there has been sporadic use of verbal report pro- 
cedures in research on reading processes, with more attention to this 
method in the past decade. Sparked by current interest in the proc- 
esses of reading, this increased use of verbal reports can be seen by 
the small but growing number of researchers who have used think 
aloud protocols in studying readers' thinking behavior (see, for ex- 
ample, Bereiter & Bird, 1985; Collins, Brown, & Larkin, 1980; 
Lytle, 1982; Olshavsky, 1975, 1977). 

Protocols have been used to study a variety of topics includ- 
ing readers' use of genre conventions (Olson, Mack, & Duffy, 
1981), the effects of readers' purposes for reading on their under- 
standing (Waern, 1979), contextual effects on recall (Christopher- 
son, Shultz, & Waern, 1981), second language learners' strategies 
(Hoscnfeld, 1979), second language learners' reading of specialized 
discourse (Cohen et al., 1979), individual differences in compre- 
hension style (Lytle, 1982), readers' strategies for understanding 
problematic expository text (Scardamalia & Bereiter, 1984), and 
readers' processing of poetry (Kintgen, 1985). 
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Think aloud protocols and protocol like activities also have 
been used in teaching procedures developed to affect students ongo- 
ing thinking while reading. These include Birds (1980) direct teach- 
ing approach, Palincsar and Brown s (1984) reciprocal teaching, and 
C. Brown's (1986) interactive protocol procedure. As nart of her ap- 
proach, Bird had entire classes of seventh graders make whispered 
protocols while she walked around listening. She also modeled spe- 
cific responses to text and used individual protocols as a measure of 
change in reading-thinking processes. Palinccar and Brown and C. 
Brown combined protocols with assessment in more open ended 
procedures that focused on readers' moment to moment responses to 
text. Basing their process on Manzo's ReQuest procedure, Palincsar, 
and Brown used a protocol like activity with individuals, small 
groups, and naturally occurring classroom groups. They preselected 
four comprehension monitoring/fostering activities to teach in a 
turn taking procedure emphasizing teacher modeling and corrective 
feedback. C. Brown used interrupted protocols to focus college stu- 
dents attention on their metacognitive processes and to foster ex- 
pansion of their characteristic responses to text. Reading protocols 
also have been used by investigators as part of assessment proce- 
dures. Myers and Lytle (1986) suggest the use of protocols as part 
of what they call Process Assessment, a model for assessing chil- 
dren with learning problems. The model evaluates the processes of 
learning by focusing on the task, the child, and the environment. 

Several of these studies provide a framework for analyzing 
protocol data and a method for using protocols in classroom instruc- 
tion. Lytle (1986) developed an analytic coding system called Types 
of Moves to describe the responses of secondary age readers to diffi- 
cult texts. Types of Moves contains six major categories and twenty- 
one subcategories. Lytle used the term move to describe the ^Verbal 
response of readers to sentences in the texf (p. 17) or what readers 
do as they make their way through the text. The six major categories 
included Monitoring of Doubts, Signaling Understanding, Analyz- 
ing Text Features, Elaboration of the Text, Judgment of the Text, 
and Reasoning. Lytle describes each category as representing a dif- 
ferent type of statement or question readers ask themselves and an- 
swer as they read. She illustrates this relationship as follows 
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(p. 127): 

Monitoring. I don't understand. This doesn't make sense. 

Signaling. What do I know? 

Analyzing. How does this text work? 

Elaborating. What does this make me think of? 

Judging How good is this? 

Reasoning. How can I figure this out? What might x 



mean? 

She also uses the term strategy to refer to "goal directed seg- 
ments or sequences" of moves (1982, p. 17). Strategies are patterns 
of moves in response to doubt, i.e., the moves readers make after 
noticing they don't understand what they have read. In Ly tie's study 
her subjects responded to doubt by using their own preferred se- 
quences of moves, or strategies. In Lytle's framework (p. 18), read- 
ing style consists of "the overall pattern of an individual's moves and 
strategies within and across texis." The notion of style can be used to 
describe readers' propensities to respond to text. In Lytle's study, 
readers' styles were found to be consistent across three nonfiction 
texts that differed in length, subject matter, and other features. She 
concluded that a reader's pattern of moves and strategies provides a 
lens for understanding intra as well as inter individual differences, 
as long as these differences are carefully related to the specific task 
and context. 

C. Brown (1986) used interrupted protocols in an instructional 
program designed to increase readers' metacongi:ive awareness. The 
Interactive Protocol Procedure (ipp) interjects suggestions to the stu- 
dent about further ways to respond to the text while the student is 
making a think aloud protocol. These suggestions are based on Ly- 
tle's Types of Moves and focus on students' use of the six major cate- 
gories of moves, their strategics, and thus their reading style. In the 
IPP, the tutor moves gradually from general to specific suggestions 
through a series of questions that assist the reader in thinking about 
the text. They begin with nondirective responses displaying interest 
and attention and only gradually become more intrusive in the stu- 
dent's thinking by suggesting and finally, where needed, modeling 
moves and strategies. Results of use of the ipp with college students in 
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tutorial settings showed changes in their use of moves and strategies. 



Think Aloud Protocols in the Classroom 

Work by Lytle (1982) and C. Brown (1986) suggests lhat 
think aloud protocols and the concepts of move, strategy, and style 
can be integrated into instructional programs that may affect indi- 
vidual readers thinking processes while reading. Here we are rec- 
ommending classroom use of protocols in a variety of ways for a 
range of purposes, all focusing on readers' processes. The goal is to 
increase both students' metacognitive awareness and their repertoire 
of possible responses to text. For example, a teacher working with a 
small group of students could guide them in making a group proto- 
col. One purpose of a group working together is to demonstrate to 
the students how much thinking readers should do in the process of 
understanding text and making a protocol, Students may be willing 
to expose their thinking in a small group where they feel comfort- 
able. The teacher could begin by raiding a short problen:atic text to 
the students one sentence at a time. As the students respond orally 
the teacher could jot their ideas on the board, gradually constructing 
a protocol of the group's responses to the text. Examples of this type 
of text follow, 

a. 

1 . He plunked down S5 at the window. 

2. She tried to give him $2.50, but he refused to lake it. 

3. When they got inside, she bought him a large bag of pop- 
corn (Collins, Brown, & Larkin, 1980, p. 387). 

b. 

1 . He stared at the bright ring with fear. 

2. As he moved closer to the ring, people began to shout. 

3. In nine rounds he might be the champ. 



When the students are finished talking, they might read their 
comments and discuss their various responses to the text. If teachers 
want a specific type of response (i,e., hypothesis or prediction) in- 
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eluded in this discussi^ n, they could model it while the group is 
making the protocol.. Students will probably notice comments per- 
taining to things they remember or experiences they have had, 
things they may notice about the way the text is written, things they 
do not understand, or questions about meaning. 

The next step is to put a short text on an overhead projector. 
Students can take turns, responding to chunks of texts as they are 
uncovered. In case teachers want to use students' comments later, 
they could jot them on the board, on paper, or on a chart or tape 
record the group. An alternative method of presenting the text would 
be to have students move an index card down the pages of their 
books, exposing some prescribed portion of the text and then discus- 
sing it. Protocols made in small groups provide assessment informa- 
tion that can be immediately integrated into the lesson. For 
example, when students verbalize a lack of understanding in the 
midst of reading, classmates or teachers can share their own think- 
ing about the passage, thus providing examples of additional re- 
sponses to the text that might help the student resolve the problem. 

Another example of classroom use of protocols to integrate 
assessment and instruction could be as a guide for whole class dis- 
cussion of a particularly difficult section of a chapter. During a typi- 
cal discussion, teachers ask questions and students answer. 
Protocols focus on the process of constructing answers. Students 
can make protocols from the title, subtitle, or first sentence and at 
several points during and immediately after reading. Teachers can 
suggest that students write responses while reading. Jottings of 
thoughts during reading can serve readily as written protocols to be 
shared later. It may be particularly beneficial to focus on students' 
lack of understanding and what they did next. Students who shared 
the same confusion may discover they used different thinking. Some 
students may have thought about related experiences they had, while 
others searched for evidence in the text to support their hypotheses 
about the meaning. Sharing these differences highlights strategy use 
and can affect students' reading styles. 

A final example of protocols in the classroom is their use in 
teaching writing. A protocol made by a classmate can guide a stu- 
dent's revising. Writing conference partners can sit together and take 
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turns making think aloud protocols fron; one another's co nposi- 
tions, essay questions, letters, lab reports, or stories. The metaphor 
"movies of the mind" muy give tne partners insight into what they 
can discuss in these protocols. They are to let their partners hear 
how they are making sense of the text. Students get immediate feed- 
back on their writing as they listen to the tentative efforts of a reader 
trying to understand what they have written. These protocol like 
conferences can help students revise for a specific audience, with 
specific comprehension problems in mind. New protocols made by 
the same partners from the rev ised drafts can examine the success of 
their efforts. 

One important effect the use of protocols has on students' 
reading at all levels is to slow down the comprehending process. 
This additional time helps students think about the ideas in the text 
and about the thinking processes readers use in understanding them. 
Such attention to reading processes stimulates students to broaden 
their responses to text, to develop a repertoire of ways to think in 
response to what they read. We are not suggesting teaching methods 
of thinking out of the context of actual reading events; we are advo- 
cating an emphasis on having students verbalize their spontaneous 
responses to text before, during, and after reading. Moves and strat- 
egies are not subskills of reading and should not be drilled or taught 
as discrete elements. In contrast to a subskills approach, we are sug- 
gesting a variety of group interactions that may help individual stu- 
dents orchestrate their own thinking processes when reading 
independently. Protocols offer a means of eliciting and reflecting on 
these processes. 



Summary 

Think aloud protocols offer potential for integrating assess- 
ment and instruction in reading. Because protocols reveal some of 
the thinking used in comprehending text, they focus attention on stu- 
dents metacognitive processes in reading. This attention provides a 
means of sharing and reflecting on individual readers thinking proc- 
esses and of guiding group work in responding to text. In addition, it 
places assessment in a context where classroom teachers can imme- 
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diately use findings to make instructional decisions and students can 
become more informed partners in the learning process. 
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Organizing and Retaining ioiormation 
by Thinking Lilie an Author 



This chapter introduces recent thinking about the role of an au- 
thor's structure in middle and secondary students' comprehen- 
sion. It describes a process for observing, assessing, and improving 
students' understanding of text structure. 

The first part of the chapter discusses research identifying 
various forms of text structure and their impact on student compre- 
hension and recall; the next part offers a rationale for observation of 
students' intuitive grasp of text structure using a think aloud proto- 
col; and the last part provides specific strategies to enhance students' 
understanding of text structure. 

Research on Text Structure 

Most people who are successful in high school and college 
have a well developed yet unconscious sense of how authors struc- 
ture ideas in both narrative and expository texts. This tacit schema 
for text structure helps us predict oncoming information in a text 
and acts as a framework for retrieval text information. Even if 
you don't know much about the specific elements of a story gram- 
mar, you can use your experiences reading narratives to reconstruct 
a decomposed story, ^fhe following story consists of randomly or- 
dered passages that need to be reordered into a normal story se- 
quence. See if you can reorganize this story into a well formed 
structure easier to comprehend. Place a number next to each section 
of the story to indicate its normal position (i.e., 1, first section; 2, 
second section). 
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Text structure 






Research Diagnosis 





Types Importance Observation Think 



aloud 

protocol 

analysis 



The Accomplice 



— Phyllis hesitated, then raised her hand to tell Mrs. 
Hampton what she saw. Unfortu' ely, eight other 
hands also were raised in response to the question about 
the U.S. Constitution. 

"Jim?" Mrs Hampton ignored Phyllis as usual, and Jim 
rambled on about various amendments. Meanwhile, the 
car thief was making his getaway m Mrs. Hampton's 
new red Supra. 

— A highly skilled car thief stalked the faculty parking lot 
just after school started. 

— Phyllis held her arm higher, cradling it in her other 
hand, but Mrs. Hampton continued to ignore her. Fi- 
nally, she lowered her hand and stared at the vacant 
parking spot where Mrs. Hampton's car was only mo- 
ments ago. She thought to herself that Mrs. Hampton 
would get a real surprise that afternoon and Phyllis 
would be there to watch. 

— Phyllis saw him through the window just as he jimmied 
the lock on Mrs. Hampton s new Toyota Supra. The man 
opened the door and stepped inside. 

If you sequenced this scrambled story in the following order 
you have an intuitive sense of story structure. 
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1. A highly skilled car thief. 

2. Phyllis saw him through the window. . . . 

3. Phyllis hesitated, then raised her hand. . . . 

4. Phyllis held her arm higher. . . . 

This underlying sense of an author's structure also applies to 
expository text. In the section that follows, both forms of text will be 
described m detail with comments about current research findings. 

If we could place a group of people in a waiting room similar 
to a dentist's outer office and watch them through a two way mirror 
as they selected reading material from a nearby coffee table, what 
might we observe? Chances are, given a choice between People 
magazine. Business Weekly, Science, and National Geographic, the 
majority would battle over People. Why? Because People naturally 
captures human interest but also because it most closely resembles 
the narrative form of text structure— a form that has its roots in the 
ancient oral tradition of story telling. Most of us prefer stories over 
exposition because stories are captivating and memorable (Graes- 
ser, 1981). During the past ten years a number of cognitive scien- 
tists and linguists have been explori'^g hov/ readers represent stories 
in memory and what role story structure plays in this process. 

Narrative structures typically contain the following major 
categories: setting, initiating event, internal response, attempts, 
consequence, and reaction. Applying these categories to "The Ac- 
complice,'' you can see that the setting is in Mrs. Hampton's class- 
room where Phyllis, our protagonist, is seen gazing out the window. 
Readers expect the setting to be the first category they encounter in 
a v/ell formed story. Next, we see Phyllis spot the car thief, thus 
supplying our story with an initiating event to get it moving. Phyllis' 
response to ♦his event initially is one of concern for Mrs. Hampton's 
car and she raises her hand to warn Mrs. Hampton. Her attempt to 
act is thwarted when Mrs. Hampton ignores Phyllis. As a result, 
Phyllis reacts by lowering her hand as the teacher's car is stolen 
from the parking lot. Phyllis gets her own form of revenge for being 
ignored by Mrs. Hampton and, in a sense, becomes an "accomplice" 
in the theft of the car. 

We know that recall of story information is better for students 
who arc able to use an author's structure as a retrieval cue. Poorer 
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readers seem to benefit most from direct instruction in story struc- 
ture (McGee & Richgels, 1986; Pearson & Camperell, 1985). Al- 
though most students have a good internal sense of story structure 
by third grade, students who are experiencing real difficulty in read- 
ing comprehension may benefit from more attention in this area. 
The question is, how can a teacher determine in a valid and reliable 
way if a student has a good grasp of story structure? That question 
and its application to expository text structure will be discussed 
later. 

Although middle and secondary students may have excellent 
senses of story structure, this is rarely true as they read increasingly 
complex expository texts in social science and science (McGee & 
Richgels, 1986). Unlike the friendly narrative pattern that has its 
roots in an oral tradition, expository text uses multiple structures 
often interleaved within a single text and sometimes highly specific 
to certain content areas (e.g., structure function patterns in biol- 
ogy). 1 he most common text patterns students encounter include the 
following described by Readence, Bean, and Baldwin (1985):* 

1. Cause/Effect This pattern links reasons with results. It is 
characterized by an interaction between at least two ideas 
or events, one taking an action and another resulting from 
that action. Social studies texts often use this pattern. 

Example. The heavy snowfall prevented the climbers from 
going to the top of the mountain. 

2. Comparison/Contrast. This pattern discusses and illus- 
trates apparent likenesses and differences between two or 
more things. 

Example. Surfing and snow skiing share similar maneuvers 
but in surfing you have to paddle out to the waves and in 
skiing a lift takes you up the mountain. 

3. Time Order. This pattern shows a sequential relationship 
between ideas or events considered in the presence of the 
passage of time. 

Example. During the fall semester, John did the research for 
his dissertation. In the spring he completed writing his dis- 
sertation and was interviewed for a position in Australia 
that will be3in this summer. 
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4. Simple Listing. This pattern is characterized by a listing of 
items or ideas. The order of the items is not significant. 

Example. Margaret got everything she needed to paint the 
fence- a dropcloth, brushes, thinner, paint, and her hat. 

5. Problem/Solution. Similar to the cause/effect pattern, this 
pattern is exemphfied by an interaction between at least 
two factors, one citing a problem and another providing a 
potential answer to that problem. 

Example. Failing to remember things is a problem that 
plagues most of us. Fortunately, a simple solution involves 
making a list of items that would otherwise slip from our 
memories, 

6. Argument. This pattern unveils pro and con arguments 
concerning a topic, ultimately supporting some favored 
view. 

Example. Skateboards should be banned on college cam- 
puses. While they provide low cost transportation for stu- 
dents between classes, they are responsible for an 
increasing number of accidents. 

♦From Reading m the Content Areas by Readence-Bean-Baldwin Copyright ® 1985 by Ken- 
dall/Hunt Publishing Company Used with permission. 

These six expository text structures represent macrostruc- 
tures writers and readers can use to portray ideas in a memorable 
fashion. In recent reviews synthesizing over ten years of research 
into the effects of text structure on students' comprehension, the 
overwhelming conclusion is that familiarity with these structures 
enhances comprehension (McGee & Richgels, 1986; Richgels et 
aL, 1987). Furthermore, direct instruction in expository patterns 
can increase comprehension (Pearson & Camperell, 1985). Re- 
search conducted by Meyer and reviewed by Meyer and Rice (^984) 
suggests that certain patterns seem to be more memorable than oth- 
ers. For example, a text that argues a point with pro and con argu- 
ments may be easier to remember than a text that simply provides 
information about a topic. In fact, fluent readers often argue with 
text that simply presents information in a dull, linear list in order to 
maintain attention and increase ,Tiemory for the information being 
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discussed (Alvermann, 1982). In addition to these macrostructure 
patterns, each has sigpal words that occur at the microstructure 
level, although authors frequently omit any explicit signals to a text s 
macrostructure. 

Cause/effect patterns often contain signal words like because, 
since, therefore, consequently, and as a result. 

Comparison/contrast patterns use signal words like however, 
but, as well as, on the other hand, and similarly. 

Time order patterns may use not long after, now, after, and 
beft)re. 

Simple listing typically uses words like to begin with, first, 
second, next, and finally. 

Research by Meyer, Brandt, and Bluth (1980) found that 
ninth grade students could be taught to use highlighted signal words 
to identify a text's structure and increase their recall of important 
information. But again, how does a teacher determine if students 
have an internal sense of expository text patterns? The section that 
follows describes a procedure for observing and judging students' 
understanding of narrative and expository text structures. 

Observation of Text Structure Understanding 

The idea of observing students as they read and discuss ideas 
in a text to determine the degree to which they are able to think like 
a writer may not seem very revolutionary. However, since the early 
1900s assessment in reading has been mired in a medical model 
with the goal of assessment being a search for deficits in the reader 
and some related internal cause (Lipson & Wixson, 1986). Rose 
(1985) traced a similar remedial view of assessment in writing that 
grew out of the 1900s desire for objective, teacher proof measures. 
Applied to writing, this form of assessment meant a search for 
grammatical errors rather than an attempt to understand the process 
a fledgling writer uses to explore ideas. In reading assessment, this 
desire for efficient scientific management of the schools led to ob- 
jective tests consisting of passage dependent literal questions cover- 
ing short passages (Moore, 1986). 

In contrast to end product, error centered measures, natural- 
istic assessment requires observation of students' reading in multiple 
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settings (Lipson & Wixson, 1986, Moore, 1986; Glazer & Searfoss, 
this volume). The first setting to use as a point of observation is the 
normal da> day classroom. Be on the lookout for signals that stu- 
^^tvdi> J?'*c asmg rai author's text structure to their advantage. What 
signals should you look for? Following are some signals of text 
structure awareness: 

1. When student.*- are re* filing a story or discussing an expos- 
itory selection, do li'^y seem to use the author's organiza- 
tional structure as the:: retelling or comments unfold? 

2. When students are writing sunimaries or essays based on 
text reading, are there iudic2tions they are using text struc- 
ture knowledge as a framework for devtioping their writ- 
ing? 

i. As you observe students taking notes, outlining, mapping 
or graphically depicting text idear, is there a pattern that 
shows they are using text structure cues to learn the con- 
cepts in a text? 

Naturally, this form of observation requires you to have a 
clear sense of the text structure patterns that occur in your class- 
room. Based on these informal observations during a\e normal flow 
of instruction, you may well identify some students v/ho appear to 
have only a partial or minimal understanding of text s ructure cues 
and their use in comprehension and writing. If so, you can then 
move to a more detailed observation of an indiv (dual student's text 
structure understandmg in a reading conference. I'his .nore detailed 
observation involves Che use of a talk aloud protc -ro. and decom- 
posed text like "The Accomplice" story you recons.m ted at the be- 
ginning of this chapter. Brown and Lytle's chapter i^ this book 
provides a detailed description of how to use think aloud protocol 
analysis. The process of diagnosing students* text ^'ructure under- 
standing will be illustrated for expository and narrative text after a 
brief description of think aloud protocol analysis. 

Tliink Aloud Protocol Analysis 

Think aloud p»*otocols have been used by reading researchers 
to gain a window on the reading process of elementary and second- 
ary students (e.g., Olshavsky, 1977). Although there is some varia- 
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tion in the process of conducting a think aloud session, depending 
on the puqx)ses desired, the following guidelines are appropriate for 
a session focusing on the assessment of a student's understanding of 
text structure. 

The actual text material you use for a think aloud session 
should be the normal text students are required to read in your class. 
Tell students they will be reading a story or text that is mixed-up. 
Ask students to read each section of the text you have cut up at para- 
graph boundaries and shuffled. It is helpful to have each section 
color coded. For example, yon might code the beginning dark blue, 
the middle yellow, and so on. That way, it will be relatively easy to 
relate students' think aloud commentaries with various sections of 
the story. To prepare the nriaterial for a session, simply shuffle the 
text sections into random order as you would a deck of cards. It is 
also a good idea to tape record the session for later analysis. 

You need to write a script to introduce a student to a think 
aloud session so tne process will go smoothly. The following script 
is adapted from Lytle (1982). 

Think Aloud Script for Assessing Text 
Structure Understanding 

I am going to give you a story (or text) to read and put to- 
gether the way you, as an author, would write it. The story 
(or text) is divided into paragraph sections that are mixed 
up. Call each section by the colored dot on it. 

Read each section to yourself silently. Tell me the 
color before you begin reading. Then read the section and 
tell me what you are doing and thinking about as you try to 
sec where this section fits in the whole story. I will just lis- 
ten and not nod or anything; in fact, ^his is more like talking 
to yourself- "thinking aloud.** I am interested in what you 
say to yourself as you read, what you are thinking about as 
you go along. 

After you have read the first color coded section and 
told everything you are thinkmg, go on to the next section 
mentioning its color. In a way, you are then telling what you 
are thinking about two sections of the story (or text), and 
then three, and so on -kind of news bulletins or play by 
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play accounts of where you are in your thoughts as you try 
to figure out how to put the story together so it makes sense. 

If you get stuck or have trouble understandings I 
would like to hear about that too and try to figure out a solu- 
tion to what's puzzling you. 

After you have read and talked about each section, 
and put the story together the way you as an author think it 
should go. Yd like to have you reflect for a while and then 
tell me your own sense of what the story was about. You can 
look bac\ at the story if you like, but try to recall the basic 
ideas in your own words. 

While you are doing this, I will say nothing. I will 
have a small notebook open because I may want to write a 
few notes to myself- things that occur to me as you talk 
about the story. I know I will have the tape to listen to but I 
have found that I sometimes can't remember ideas unless I 
write them. 

In order to illustrate the use of think aloud protocols in ob- 
serving a student's sense of text structure, a session showing a fluent 
college age reader reconstructing the campfire horror story, "Cold 
and Clammy'' (Christen, Searfoss, & Bean, 1984), will be dis- 
cussed. Lytle (1982) has developed a system for analyzing observa- 
tions of students' think aloud protocols that will be used to consider 
the students' transcript. But first, here is the complete "Cold and 
Clammy" story in the correct sequence. 

Cold and Clammy* 

Sue and Eve were nursing students who occupied the same 
apartment. S.ie was pretty, vivacious, and always had plenty 
of dates. She also greatly enjoyed playing practical jokes on 
other people. Eve was just the opposite, quiet, somewhat 
withdrawn, though also very intelligent. 

The two had a minor argument one morning, and Sue 
decided to get even with Eve. Sue knew that Eve would be 
studying late at the libra? y that evening, as usual. So she 
concocted a plan. 

They were dissecting cadavers in her nursing class, 
and it would be easy for Sue to secretly remove an arm from 
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class. First, she would attach the cold, clammy, dead arm to 
the light switch in the apartment. The switch was the kind 
with a chain you pull in order to turn on the light. That was 
the difficult part since the arm was .so bulky and unwieldy 
and the switch so flim.sy. Sue used a thin rope and fa.stened it 
to one end of the arm and hooked the other end to a nail in 
the ceiling next to the switch. If .someone reached for the 
switch, they would grasp the arm instead! 

Soon after 10:30, Eve could be heard fumbling at the 
door, struggling to get her key into the keyhole. She mum- 
bled something about Sues alway.s forgetting to leave the 
porch light on for her, and then she entered the gloomy 
room. She took a few tentative .steps and reached up to turn 
onthe light. Nothing happened! 

The neighbors later reported that there were no 
strange noi.ses or .screams from the house until after Sue had 
returned home and found Eve. V/hen Sue did come home, 
she was laughing as she opened the door. Entering the dark 
room, .she hoped that Eve had already returned and made 
the grisly discovery. She turned on the light and was sur- 
prised to find Eve standing in the middle of the room clutch- 
ing the arm. Eve's hair turned white! She was in shock and 
was destined to never recover. Later, she was committed to 
an institution for the hopelessly insane and wasted her 
promising life. 

Sue probably would never play a joke on anyone 

again. 

♦From /fnpnnmfi Commumcaium through Wntm)^ and Raulinf: h\ ChnMcn-ScMrlONs-Bcjn 
O^pynghj *^ 1984 by Kcndall/Hunt Publishing Company Used xviih permission 

Lylle's (1982) system for analyzing think aloud protocols 
contains six moves a reader is likely to make in attempting to com- 
prehend a text. These moves are: 

\ . Monitoring. I don't understand. This doesn't make sense. 
Manifested in statements or questions indicating the reader 
doubts his/her understanding (including conflicts). 
2. Signaling. What do I understand? 

Manifested in statements in which the reader .signals his/ 
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her current understanding of the texts meaning (agrees, 
paraphrases, summarizes). 

3. Analyzing. How does this text work? 

Manifested in statements in which the reader, viewing the 
text as an object, notices, describes, or comments on the 
features of text (e.g., words, sentences, text structure, 
style). Thus, for the purpose of observing a readers sense 
of text structure, we would expect to see this move occur 
within the think aloud process. 

4. Elaborating. What does this make me think of? 
Manifested in statements describing the ways the reader is 
responding to or experiencing the text such as imagery, re- 
calling prior knowledge, liking/disliking. 

5. Judging. How good is this? 

Manifested in statements indicating the reader is evaluat- 
ing the text (ideas or text features). 

6. Reasoning. How can I figure this out? What might X 
mean? 

Manifested in statements or questions indicating the reader 
is trying to resolve doubts and interpret the text (e.g., hy- 
pothesis, prediction, question, use of evidence). 
The student reconstructing this story is named Vicki. After 
listening to the script describing the task of thinking aloud while 
putting the story back together in the fashion of an author, Vicki 
received the following scrambled version of the story. Notice that 
each .section of the story is color coded. The story part:- are labeled 
in this version but they were not part of the version Vicki received. 

Cold and Clammy 

black (mitiating event) 

The two had a minor • 'ment one morning, and Sue de- 
cided to get even ' ' knew that Eve would be 
studying late ? . , i/>al evening, as usual. So she 
concocted a plar 

Vicki: Okay. This is probably at the beginning of the story. 
There could be some other things th u happened but some- 



ERIC 



IP o 

-ganizing and Retaining Information ^ i 13 



thing has been happening before this because she concocted a 
plan. So obviously she's been thinking she needs to get sonfie- 
thing done. So something happened before so Sue probably 
wanted to get in touch with Eve. To do something with her. 
In this instance, Vicki is analyzing the content of this section 
in c.der to determine where it fits in the flow of the story. At this 
point sr.e has only this one section so her conclusions about its role 
in the story are tentative but she appears to have a good grasp of the 
story structure. 



red (resolution) 

The neighbors later reported that there were no strange 
noises or screams from the house until after Sue had re- 
turned home and found Eve. When Sue did come home, she 
was laughing as she opened the door. Entering *'ie dark 
room, she hoped that Eve had already returned aiid made 
the grisly discovery. She turned on the light and was sur- 
prised to find Eve standing in the middle of the room clutch- 
ing the arm. Eve's hair turned white! She was in shock and 
was destined to never recover. Later, she was committed to 
an institution for the hopelessly insane and wasted her 
promising life. 



Vicki: This happened after black because Sue has . . . be- 
cause it says Sue returned home and found Eve, so, I guess. 
. . .Well, maybe not, it could be. Most likely it happened 
after that. Obviously while Eve was at the library Sue set up 
something al home for Eve to return and discover. This is 
near the end. 

Vicki uses the previous section of the story as a benchmark 
for comparison with this new section. Her initial response shows 
some confusion about this section's place in the story, largely be- 
cause she began talking aloud before completing her reading of the 
passage. Her initial response displays features that correspond to 
Ly tie's "reasoning" move. Once Vicki completes reading the passage 
she analyzes the section's position in the story with more assurance. 
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Again, Vicki illustrates a fluent reader treating a text as an object of 
analysis. 

green (outcome of attempt to achieve 
a goal or solve a problem) 

Soon after 10:30, Eve could be heard fumbling at the door, 
struggling to get her key into the keyhole. She mumbled 
something about Sue's always forgetting to leave the porch 
light on for her, and then she entered the gloomy room. She 
took a few tentative steps and reached up to turn on the 
light. Nothing happened! 

Vicki: This is Eve returning home. So this occurred before 
Sue got home and found Eve and all that. 

blue (main character's attempt to achieve a 
goal or solve a problem) 
They were dissecting cadavers in her nursing class, and it 
would be easy foi Sue to secretly remove an arm from class. 
First, she would attach the cold, clammy, dead arm to the ♦ 
light switch in the apartment. The switch was the kind with 
a chain you pull in order to turn on the light. That was the 
difficult part since the arm was so bulky and unwieldy and 
the switch so flimsy. Sue used a thin rope and fastened it to 
one end of the arm and hooked the other end to a nail in the 
ceiling next to the switch. If someone reached for the 
switch, they would grasp the arm instead! 

Vicki: Okay. This is when Sue is setting up the thing for Eve. 
So, that comes before green. 

At this stage in the process, Vicki has enough of the text and 
enough prior knowledge about story structure to quickly decide 
where each piece fits. Notice that her comments are confined to an- 
alyzing story structure rather than content, which is consistent with 
the purpose of this particular think aloud task. 

brown and red (ending and moral) 

Sue probably would never play a joke on anyone again. 

Vicki: That has to be the ending. 
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orange (setting and character i.itroduction) 

Sue and Eve were nursing students who occupied the same 
apartment. Sue was pretty, vivacious, and always had plenty 
of dates. She also greatly enjoyed playing practical jokes on 
other people. Eve was just the opposite, quiet, somewhat 
withdrawn, though also very intelligent. 

Vicki: This is the beginning that's introducing who they arc. 
When Vicki was asked to retell the story she demonstrated a 
strong sense of the story's macrostructure. At this point it would 
have been a good idea to have Vicki reread the entire story in its 
original, cohesive form to ensure good comprehension before re- 
flecting and retelling the story. Because Vicki did not do this, her 
retelling shows some confusion of events which she resolves by 
looking back at the story. 

Vicki: Sue and Eve were nursing students. Sue decided to 
play a trick on Eve. While Eve was at the library. Sue went 
and got a cadaver's arm from their nursing class and attached 
it to a hanging light cord. So that when Eve came home the 
light switch wouldn't work so she had to walk over and puil on 
the cord to turn on the light. So she grabbed the arm. . . . 
No, that's not right. She grabbed the arm and the shock killed 
her. No, it didn't kill her- she went to an institution for the 
hopelessly insane. 

Overall, Vicki's reconstruction of the story and subsequent 
retelling display three of Lytle's ^^moves." Given the nature of the 
reconstruction task, she analyzes text features. During the retelling, 
Vicki monitors and signals any hitches in her understanding and 
comfortably resolves them. In essence, Vicki has a well developed 
sense of story structure to guide her comprehension. Is her sense of 
text structure as strong in expository material? The next section 
shows Vicki's think aloud protocol for a brief problem solution pas- 
sage concerning earthquakes (Christen, Searfoss, & Bean, 1984). 

Earthquakes* 

Earthquakes, in themselves, are not a significant hazard. 
The documented cases of a fault opening up and encompass- 





Bcan 



ing people and then burying them can, perhaps, be counted 
on one's fingers. Landslides can, and do, take a significant 
toll of lives, but in mos* cases these hazards are relatively 
self-evident before the earthquake and do not need an earth- 
quake to trigger them. The major life hazard in the usual 
earthquake is from the collapse of man made structures such 
as buildings and dams. This is certainly true for all of Cali- 
fornia as well as San Francisco. 

The solution to seismic hazards is to design and con- 
struct buildings in such a manner that they will remain safe 
during and after an earthquake, with damage limited to ac- 
ceptable economic and functional levels. Ideally, then, an 
earthquake would become an exciting experience, but not a 
hazardous adventure. 

However, tearing down all existing construction and 
replacing it with earthquake resistant construction has over- 
whelming limitations. Financial and material resources 
simply do not exist, technologies are inadequate for some 
cases, and only over time can these hazardous buildings be 
replaced. 

At the local government level, the city of San Fran- 
cisco is emulating the long established Los Angeles policy 
of removing or bracing all hazardous nonreinforced brick 
parapets and appendages. Worldwide earthquake experi- 
ence clearly shows that these hazards are serious even in 
moderate shocks. 

*Froni Improving Communuaiion through Wniing and Reading b> Christen-Searfoss Bean 
Copyright ^ 1984 Kendall/Hunt Publishing Compan> Used with permission 

Vicki received this passage scrambled in the following fash- 
ion. She was given the whole passage rather than a section at a time 
because the passage is much less structured than a narrative. 



However, tearing down all existing construction and replac- 
ing It with earthquake resistant construction has overwhelm- 
ing limitations. Financial and material resources simply do 
not exist, technologies are inadequate for some cases, and 
only over time can these hazardous buildings be replaced. 



yellow (limitations of the solution) 
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orange (problem) 

Earthquakes, in themselves, are not a significant hazard. 
The documented cases of a fault ooening up and encompass- 
ing people and then burying them can, perhaps, be counted 
on one's fmgers. Landslides caa, and do, take a significant 
toll of lives, but in most c.isec? these hazards are relatively 
self-evident before the earthcu^kc and do not need an earth- 
quake to trigger them. The iiajor life hazard in the usual 
earthquake is from the collapse of man made structures such 
as buildings and dams. This is certainly true for all of Cali- 
fornia as well as San Francisco. 

brown (examples) 

At the local government level, the city of San Francisco is 
emulating the long established Los Angeles policy of re- 
moving or bracing all hazardous nonreinforced brick para- 
pets and appendages. Worldwide earthquake experience 
clearly shows that these hazards are serious even in moder- 
ate shocks. 

blue (solution) 

The solution to seismic hazards is to design and construct 
buildings in such a manner that they will remain safe during 
and alter an earthquake, with damage limited to acceptable 
economic and functional levels. Ideally, then, an earthquake 
would become an exciting experience, but not a hazardous 
adventure. 

The range of Vicki's comments as she assembled this exposi- 
tory passage were greater than in the narrative example. She dis- 
plays a clear sense of structural cues, ultimately reconstructing the 
passage in a defensible fashion, albeit different from the author's. 
The following comments from her think aloud transcript reveal the 
process she went through in thinking like an auti or. 

Vicki: This one is hard. Okay. The first one Fm going with is 

orange (the problem) because it talks about earthquakes. 

Well see. 
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At this point, a fair amount of think time passes as she con- 
siders the other three sections of the passage. 

Vicki: The solution. That one has to go last or toward the 
end. The brown one could be last too. However, yellow could 
go after brown. All right, let's see how this goes. Orange, 
blue, brown, and yellow. Help^ I don't know how this goes 
together. I don't think ^his is a very good passage. Orange 
(the problem), brown (examples), yellow (limitations of the 
solution), and blue (solution). 

Examining Vicki's final choice as an author shows a passage 
that, if anything, uses cohesive ties and transitions more effectively 
than the original passage. For example, the first paragraph ending 
with the reference to San Francisco leads logically into the example 
of how San Francisco is coping with the earthquake problem. Simi- 
larly, the next paragraph poses limitations of Los Angeles' expensive 
solution to the earthquake problem, Finally, the solution posed in 
the last paragraph seems to logically fit at the end, as Vicki sug- 
gests. The point is, a student may reconstruct an expository passage 
in a cohesive, sensible fashion that departs from the author's original 
structure. If this student's think aloud transcript shows evidence of 
sensitivity to text structure cues, comprehension of the passage is 
likely to be excellent. Indeed, Vicki's retelling of the earthquake 
passage indicated she had a clear grasp of its meaning. 

Based on the two think aloud transcripts, Vicki does not ap- 
pear to be a candidate for direct instruction in text structure cues. 
She already has a tacit understanding of signal words in texts and 
dominant patterns authors use to portray ideas. Not all students de- 
velop this awareness of text structure without teacher guidance, es- 
pecially in the middle grades, junior high, and high school. The 
following example shows Brian, a sixth grader, attempting to recon- 
struct an expository passage about "Animal Hiding Places" (adapted 
from McCauley, 1986). The passage follows a problem solution 
structure and Brian does not seem to use this structure and some of 
the key words in the passage as he goes about thinking aloud and 
assembling the scrambled paragraphs. The original text is presented 
first, then Brian's think aloud. 
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Animal Hiding Places 

Most animals face the problem of finding a good place to 
hide from their predators. Some animals are lucky enough 
to have a built-in disguise that helps them hide, (ycliow) 

A turtle tucks itself tightly inside its hard shell. It 
looks like a rock. A parrotfish blows a clear, jellylikc bub- 
ble around itself when it wants to rest in the coral reef. The 
bubble protects the parrotfish from predators, (brown) 

Some animals must borrow disguises or create hiding 
places from objects around them. The hermit crab lives in a 
hard shell left by another animal. Sea urchins cover them- 
selves with rocks aaJ seashells. (blue) 

All animals find some way to protect themselves 
from their predators. Tnink about other animals you have 
seen that have special hiding places, (red) 

In this particular think aloud, Brian was given all four para- 
graphs to consider, scrambled in the following way. 

1. Blue: Some animals borrow disguises. . . . 

2. Yellow: Most animals face the problem. . . . 

3. Red: All animals find some way. . . . 

4. Brown: A turtle tucks itself. . . . 

Brian's think aloud is brief. After considering all four para- 
graphs, he said, "I don't know. It looks okay the way it is. It talks 
about how animals hide. The different ways. . . .1 want to leave it 
. . .the way it is." 

Brians reluctance to manipulate the passage", is, in part, a 
result of little direct instruction in text structure patterns. One col- 
lection of words and paragraphs is about as good as another in his 
view. How can you help students like Brian develop a sense of text 
structure? 

The following section describes graphic and structural orga- 
nizers, two strategies you may want to use to help students grasp an 
author's structure. 

Graphic Organizers 

A graphic organizer is a visual display of the hierarchical 
structure of ideas in a text (Earle & Barron, 1973). A partially com- 
pleted, teacher constructed graphic organizer can help students be- 
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come sensitive to an author's text structure (Readence, Bean, & 
Baldwin, 1985). First, identify the dominant structure of a text pas- 
sage, For example, the following passage from a children's book. 
How Come . , . ? Easy Answers to Hard Questions (Richards & 
Perl, 1975, p, 20) answers the question, "How does a caterpillar 
become a butterfly?" It represents an informational pattern typical 
of expository text material students read in school. 

A caterpillar is a butterfly's baby and it grows in three 
stages: egg, caterpillar, chrysalis. The tiny egg is laid by its 
mother on a favorite leaf. Soon the tiny caterpillar inside 
chews through its shell and begins eating its leaf and every 
other leaf around. It is very greedy. 

It grows very fat, very fast. Its old skin gets too small 
and it has to wiggle out of ii. A soft new skin is always 
ready underneath. This process is called molting. It molts 
four or five times in butterfly babyhood, 

Sometimes it changes color and spoti after a molt. 
But it keeps six real legs and all its soft baby legs to support 
its long back. 

Then one day it loses its appetite and leaves its leaf. 
!t goes looking up and down stems and stalks for a safe 
place to become a chrysalis. This will be its last molt. It 
gets a new skin and a new shape. It may look like a twig or a 
piece of bark. It stays quiet in its chrysalis for a long time. 

Then one morning-pop! -the chrysalis cracks. And 
a gorgeous butterfly pokes out. Its wings are wet and rum- 
pled at first. But soon it dries out and flutters off into the 
sun to mate with another butterfly. More eggs, caterpillars, 
chrysalids. The cycle never stops. 
(Used by permission of publisher.) 

This partially completed graphic organizer is designed to key 
students to the structure of the passage and the three stages of a cat- 
erpillar's transition to a butterfly. 




3 Stages 




Egg 



Caterpillar 



(Molting) 
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Students have to complete the graphic organizer by identify- 
ing the third and final stage leading to the formation of a butterfly. 
Subsequent informational passages then can be introduced to show 
their similarity and help students actively look for signal words such 
as "3 Stages" in the case of this passage. 

McGee and Richgels (1985) recommend teaching elementary 
students about text structure patterns through writing activities. Stu- 
dents are given a graphic organizer like the one shown with all the 
slots filled and interrelationships of ideas shown Hpfore reading a 
passage. Before reading the passage, they are asked to write their 
own selection based on the information in the organizer. This stu- 
dent generated passage is then compared with the actual text. Stu- 
dents can see similarities and differences and eventually move 
toward more challenging activities including developing their own 
graphic organizers (Bean et al., 1986) or they can evaluate and re- 
write ill structured passages (McGee & Richgels, 1985). Alver- 
mann (1986) describes additional forms of graphic organizers that 
help students grasp a knowledge of text structure and a metacogni- 
tive strategy they can apply on their own. 

Structural Organizers 

Slater, Graves, and Piche (1985) developed a procedure 
called a structural organizer for explicitly introducing students to 
the structure of a text passage. Basically, a structural organizer con- 
sists of an explanation of why using an author's pattern of organiza- 
tion is important, alerting students to the actual pattern of 
organization they will encounter in a reading assigh.T.cnt and guid- 
ing their use of this pattern by supplying a partially completed out- 
line of the text to be filled in as they read. Slater et al. found that 
ninth grade students' comprehension of social studies text was sig- 
nificantly better when a teacher used structural organizers students 
completed as opposed to teacher generated organizers and more tra- 
ditional study strategies. These results were true for high, middle, 
and low ability students. 

The following structural organizer was devised to accompany 
a newspaper article about the Hmong people who recently immi- 
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grated to the United States from Laos (Patemo, 1986). For the pur- 
poses of this illustration, only an adaption of an excerpt of ihe article 
will be used. 



Problem Solution Structural Organizer 

As you read this newspaper article, notice how the author 
organizes ideas into a problem solution structure. Doing 
this will help your understanding in at least three ways: The 
problem solution structure will help you remember more of 
what you are reading, you will be able to recall more of the 
major ideas (problems), and you should be able to remem- 
ber this information for a longer period of time. 

The article describes the problems confronting a 
group of people who must leave their homeland of Laos for 
the United Slates. As you read the article, look for the prob- 
lems these people experience and think about solutions you 
might offer. The outline that follows has a place v^-here you 
can write each of the problems. Do this as you are reading, 
not after reading Each problem can be found by locating its 
paragraph number in parentheses ( ) on the outline and in 
the text. 

A Quick Journey from the 16th Century to the 20th 
Susan Patemo 

1 . Problem (paragraph 2) 

The Hmong expected Americans to greet them as he- 
roes. Few Americans knew about the war in Laos or 
about the Hmong . 

2. Problem (paragraph 4) 



3. Problem (paragraph 6) 



Solution 



4. Problem (paragraph 8) 
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Solution 



5. Problem (paragraph 9) 



6. Problem (paragraph 10) 



Solution 



A Quick Journey from the 16 Century to the 20th 
Susan Paterno 

(1) After the war, thousands of the Kmong fled Laos to 
escape torture and death as the Pathet Lao army took 
over. They spent years in refugee camps before coming 
to the United States, to live in the cities where spon- 
sors could be found. 

(2) Most Hmong expected Americans to greet them as he- 
roes, since thousands died fighting as U.S. allies. But 
few Americans knew about the war in Laos, and fewer 
k;.ew or cared about the Hmong. 

(3) Nai Her tried to practice his English with a young 
woman sitting next to him on a bus. She rebuked him. 
"Why arc you here?" Why don't you go back to your 
own country? You're not working; youVe all on wel- 
fare." 

(4) Racism is only one of the Hmong*s problems. When 
refugees come here» everything that was true is no 
longer. Americans tell refugees their values are wrong, 
-^nd the refugees no longer know what is right. 

(5) Many Hmong hoped to retain the traditions that kept 
their communities stable in Laos-arranged mar- 
riages, olygamy, patriarchy. As animists, they respect 
the spirits of the river, wind, sea, and sky. They honor 
ancestors in ceremonies that transport their spiritual 
leaders into the netherworld by way of convulsions and 
trances. 

(6) Forced to abandon their culture in most U.S. cities, the 
Hmong began migrating, just as they had done in Laos 
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when their lifestyle was threatened. Many headed for 
California's central valley hoping to farm. 18,000 
drifted to Fresno, Merced, and Stockton, following a 
path forge<i years earlier by the Basques, Armenians, 
Japanese, and Oklahoma's Dust Bowl victims. 

(7) Most Hmong cannot find jobs; funds to support them 
arc dwindling. Roughly 60 percent are unemployed 
(down from 90 percent a few years ago). 

(8) When the Hmong arrived, Fresno school officials com- 
plained about Hmong children, who came to class with 
head lice and terrible odor. The children's families 
knew nothing about soap or toothpaste or changing 
clothes. According to Eileen Riley, a teacher who over- 
sees the Fresno school districts migrant education pro- 
gram, **they'd sleep in their clothes and wear them day 
after day. We got them nightgowns and wc taught them 
hygiene. ThcyVe very receptive.'' 

(9) Hmong always wear clothes covering the area from 
their waist to their knees, even when alone. In the refu- 
gee camp, one Hmong won^an asked about bathing in 
America. The woman was horrified at the description 
of taking a shower. "I could never take my clothes off," 
the woman said. "I'd be much too embarasscd, even if I 
were alone.'' Even in the United States, Hmong women 
shower wearing sarongs; men wear shorts. Many tcen- 
ige girls would rather drop out of school than shower 
after gym class. 

(10) Another problem: Hmong girls were leaving seventh or 
eighth grade to get married. It's against U.S. law, but in 
their law, marriages are arranged and girls do what 
their parents tell them. However, that is changing fast; 
they realize the only way to succeed here is to become 
Americanized. 

(11) Americanization has its painful aspects. Older Hmong 
worry that their adult children will send them to die in 
nursing homes. Meanwhile, Hmong teenagers fit in by 
forming rock bands, spiking their hair, and wearing 
heavy makeup. 

Both graphic organizers and structural organizers help stu- 
dents develop foundational knowledge about a topic. This is an im- 
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portant first step in any lesson sequence but it is not enough. The 
article about the Hmong people implies that the solution to the 
Hmong's culture shock is to assimilate -to abandon their ways and 
Americanize. This unidimensional solution could be a springboard 
for a problem solving discussion in class that explores less ethno- 
centric solutions. Careful teacher questioning might elicit more cre- 
ative, less culturally biased solutions from students. In essence, 
understanding an author's pattern of organization is a starting point, 
a foundation for creative, critical thinking. 

Both graphic and structural organizers take teacher time to 
develop and introduce but their benefit to students makes the effort 
worthwhile, Both strategies prime students to pay attention to an au- 
thor's use of language in an informed fashion. 

Summary 

In this chapter, research on text structure showed that teach- 
ing students lo perceive an author's structural cues helps compre- 
hension and recall of information. The value of observing students' 
use of these cues during the normal flow of classroom instruction 
was discussed, and think aloud protocol analysis was demonstrated 
as a means of observing individual students. Finally, two teaching 
strategies -graphic organizers and structural organizers -were in- 
troduced. Both are designed to enhance students' metacognitive 
awareness and use of text structure. 
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Lesley Mandel Morrow 



Retelling Stories as a Diagnostic Tool 



This chapter describes retelling as a diagnostic tool for assessing 
comprehension of text and stories, sense of story structure, 
and language complexity. In addition, some consideration is given 
to retelling as an instructional strategy. Although retelling has beeii 
used as an assessment tool in research investigations, it is not 
widely recognized as a technique for diagnosis or measurement in 
the classroom. Similarly, it is not widely used as an instructional 
strategy, although investigations have demonstrated its ability to im- 
prove comprehension, sense of story structure, and language com- 
plexity (Morrow, 1985; Gambrell, Pfeiffer, & Wilson, 1985; 
Zimiles & Kuhns, 1976). 

In story retelling, as the technique is discussed in this chapter, 
an individual recalls orally a text or story after having read or lis- 
tened to it. As Johnston (1983, p. 54) points out, "Retelling is the 
most straightforward assessment ... of the result of text-reader in- 
teraction." It is often used as an assessment tool in reading research. 
Because retelling can indicate a reader's or listener's assimilation 
and reconstruction of text information, it can reflect comprehen- 
sion. It has at least one advantage over the more traditional practice 
of assessing comprehension through questions: Retelling allOv»s a 
reader or listener to structure response according to personal and 
individual interpretations of the text. 

Procedures for Eliciting Retellings 

Retelling is not an easy procedure for students, no matter 
what their ages and especially if they have had no prior experience. 
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Using retelling in the classroom 

Eliciting retellings Assessment ^ Instructional strategy 
strategy 

Comprehension 

Appendix A— Methods 
of quapiiitative and 
qualitative assessment 

Storv structure 
' \ 

Appendix B--Analysis 
of a retold story 

Language 

Appendix C—Techniques 
of language analysis 



Morrow (1985) found that children had difficulty retelling, but prac- 
tice added to the quality of retellings and to the ease with which 
students approached the task. Children need guidance and practice 
before retelling is used in formal evaluation of any of their skills or 
abilities. 

Students should be told before reading or listening to a text or 
story that they will be asked to retell it. Further guidance depends 
on the purpose for retelling. If the immediate intent is to teach or 
test sequence, the child should be instructed to concentrate on what 
happened first, second, and so on. If the goal is to teach or assess 
ability to integrate information and make inferences from text, the 
child snould be instructed to refer to personal feelings or experi- 
ences related to the text. Props such as feltboard story characters, 
graphs, or pictures from text can aid students in retelling. In using 
retelling as a teaching technique, pre and post discussions of the 
story or text will often help improve the skill of retelling (Mitchell, 
1984; Morrow, 1985). It is also helpful to conduct followup practice 
sessions and discussions about the quality of retelling. 

Because accurate assessment depends on accurate analysis, 
chiiaren's retelling should be recorded for playbacks as needed by 



E R^C ^telling Stories as a Diagnostic Tool 1 ,9 ^ ^ 



the examiner or analyst. Guidelines for eliciting and coaching a 
child's retelling follow (Morrow, 1985): 

1 . Ask the child to retell the story by saying, **A little while 
ago, I read the story (name the story). Would you retell the 
story as if you were telling it to a friend who has never 
heard it before?*' 

2. Use the following prompts only when necessary: 

If the child has difficulty beginning the story retelling, 
suggest beginning with "Once upon a time. . ^ or "Once 
there was. . . 

If the child stops retelling before the end of the story, en- 
courage continuation by asking, "What comes next?" or 
"Then what happened?" 

If the child stops retelling and cannot continue with the 
prompts offered, ask a question about the story that is rele- 
vant at that point in the story at which the child has 
paused. For example, "What was Jenny's problem in the 
story?" 

3. When a child is unable to retell the story, or if his or her 
retelling lacks sequence and detail, prompt the retelling 
step by step. For example: 

"Once upon a time. . . ," or "Once there was. . . ." 
"Who was the story about?" 

"When did the story happen?" (day, night, summer, win- 
ter) 

"Where did the story happen?" 

"What was the main character's problem in the story?" 

"How did she try to solve her problems?" "What did she do 

first/next?" 

"How was the problem solved?" 
"How did the story end?" 

Retelling for Assessment 

In retelling for purposes of evaluation, students should be 
told before reading or listening to a story that they will b j asked to 
retell it. Depending on the information the evaluator is looking for, 
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students also should be given a stated purpose for their ..ading/lis- 
tening. If a specific skill is to be analyzed in the assessment, stu- 
dents should be advised to pay particular attention to that skill. For 
example, if the ability to sequence is to be assessed, the evaluator 
should tell students that in retelling the story they should try to tell it 
with events in the order in which they happened. 

Unlike retelling for instruction?! purposes, retelling for as- 
sessment should be carried out without prompts, props, or use of 
text/story. The text/story should not be discussed with the child after 
reading/listening and before retelling. Simply ask the child to retell 
the story/lext as if telling it to a friend who has never heard it be- 
fore. 

Retelling for Comprehension 

Retelling offers the potential of measuring Hoth the product 
and process of comprehension (Morrow et al., 1986). Children's 
ability for literal recall -remembering facts, details, cause and ef- 
fect relationships, sequencing of events-can be diagnosed through 
retelling. Children reveal their ability to make inferences as they or- 
ganize, integrate, and classify information that is implied but not 
expressed in the text story. In such instances, children may general- 
ize, interpret feelings, relate ideas to their own experiences (Irwin & 
Mitchell, 1983; Lanier & Davis, 1972; McConaughy, 1980; Mor- 
row, 1984), and engage in holistic comprehension (Morrow et i., 
1986). 

To assess comprehension through retellings, both quantitative 
and qualitative methods should be considered. 

In quantitative assessment, readers or listeners should be di- 
rected to retell all they can remember from the text. The examiner 
will have parsed the story/text into units to assessed (e.g., propo- 
sitions, idea units, elements of story structure). The pr<^tocol of the 
reader's/listener's retelling is then parsed into identical units and 
compared with the text units. I'he match betv een protocol units and 
text units represents the reader's/listener's comprehension score 
(Gambrell, Pfeiffer, & Wilson, 1985; Kintsch & Kozimnsky, 1977- 
Morrow et al., 1986). 
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Quantitative assessment has both advantages and disadvan- 
tages in measuring comprehension. It tends to reflect recall of text 
based facts, details, sequence, and structural elements. On the other 
hand, it does not provide for scoring inferences that indicate mks 
children make between text and prior experience. Usually it does 
not rate the importance of the various units of information recalled 
in the retelling. Mitchell (1985) notes that in determining compre- 
hension, both qualify and quantity of information aie important. 

Qualitative assessment focuses on children's ueeper under- 
standing of the story /text. Sometimes referred to as holistic ratings, 
qualitative analyses take into account student's generalizations be- 
yond the text (e.g., interpretive remarks, ability to summarize, bi- 
ases for or against information in the text). In addition to major 
points and details, qualitative assessment documents supplementa- 
tion, coherence, completeness, and comprehensibility (Ir^^in & 
Mitchell, 1983). 

Similar to the holistic grading systems for written composi- 
tion developed by Cooper (1977) and Meyers (1980), qualitative 
analysis for retelling is based on the premise that the whole piece is 
more important than any of its parts and holds that a subject's total 
impression of a sample includes all those elements. 

Appendix A offers samples of both quantitative and qualita- 
tive procedures for assessment of retelling. 

Retelling Sense of Story Structure 

Retelling makes it possible to assess the form of comprehen- 
sion evident in children's sense of story structure. Mandler and 
Johnson (i'^.-^%, Rumelhart (1975), Stein and Glenn (1979), and 
Thomdyke '0 have described story structures and story gram- 
mars. Accordiu^ ^r;ese investigators, well formed stories have 
stnictures that include setting (time, place, characters), theme (an 
initiating event that causes the maii. character to react, form a goal, 
or face a problem), plot episodes (events in which main character 
attempts to attain goal or solve the problem), and a resolution (at- 
tainment of goal or solution of problem and ending of the story, 
which may have long term consequences). 
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While ages seem to determine the number of story elements 
children typically include in their retellings, several researchers 
have reported that young children generally have some concept of 
story structure (Applebee, 1978; Mandler & Johnson, 1977; Stein 
& Glenn, 1979; Thorndyke, 1977). From ages four to six, children 
tend to include settings, beginnings, and outcomes in their retell- 
ings. Early elementary students also include reactions, attempts, 
and endings. One researcher (McConaughy, 1980) found that youn- 
ger children m jre easily recall story elements that contribute more 
directly to meaning. 

Enhancing comprehension through development of a sense of 
story structure has become an area of greater interest among educa- 
tors. In several studies childien have been trained to develop aware- 
ness of story schemata by identifying and labeling structure 
elements within stories. Results indicate signilicant growth in com- 
prehension (Bowman, 1981; Gordon & Braun, 1982; Spiegel & 
Whaley, 1980), On the other hand, children with little or no sense of 
story structure tend toward "fractured" retellings, with elements 
missing, unexplained, or out of sequence (Bower, 1976). If children 
are encouraged to develop and use schemata in retelling stories, they 
can anticipate elements of a story and deciae which are most impor- 
tant to remember (McConaughy, 1980; Sadow, 1982; Whaley, 
1981a). Whaley (1981b) reinforces the idea that children can de- 
velop a sense of story structure by retelling stories. 

In summary, retelling can both develop and reveal children's 
sense of story structure. Assessment of retelling can identify the 
structural elements children include in a retelling and thus measure 
their sense of story structure. 

To assess a child's retelling for its sense of story structure or 
inclusion of structural elements, the examiner should first parse the 
story into four scoreable units: setting, theme, plot episodes, and 
resolution. A fifth element, sequence, offers the opportunity to eval- 
uate how appropriately the child retells the story in sequential order. 

The child is then asked to retell the story. To analyze the re- 
telling for its inclus: of structural elements, the examiner notes 
the number of idea units the child includes within the fiiSt four 
structural categories, regardless of orde:. A story guidesheet, out- 
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lining the parsed text, is used to record the idea units the child in- 
cludes in the retelling. The child receives credit for a partial recall 
or for recounting the gist of a story element (Pellegrini & Galda, 
1982; Thomdyke, 1977). 

Having checked off the child's inclusion of elements, the ex- 
aminer observes sequence by comparing or contrasting the order of 
elements in the child's retelling with the proper order of setting, 
theme, plot, episodes, resolution. 

Tne analysis indicates the elemem^i a child includes or omits, 
how well a child sequences, and where instruction might be neces- 
sary to develop an area in which the child's retelling has been partic- 
ularly weak. 

The procedure can be used with a point system that allows 
quantification of scores for an indication of a child's progress over a 
period of lime. Appendix B illustrates analysis of a retolo story with 
a parsed story, a sample verbatim transcription of a retold story, and 
a story retelling evaluation guidesheet with a sample analysis of a 
retelling. 

Retelling for Measuring Language 

In addition to offering a source of information for assessing 
comprehension and sense of story structure, rel Ming provides a 
corpus of uninterrupted language for assessment. The language 
sample generated during a retelling can be analyzed for number of 
words, number of different words, number of T-units, T-unit 
lengths, pronunciation, and syntactic complexity. Analysis of syn- 
tactic complexity reveals types of sentence patterns a child uses as 
well as granr^matical structure. Knowledge and use of language is 
crucial to a child's development of literacy. Frequent analysis and 
assessment of samples of a child's oral language are desirable in 
guiding instruction. Retellings provide easily obtainable language 
samples for such assessment. 

Developmental studies of oral language indicate that length of 
T-unit it is a reliable measure of language complexity (Hunt, 1965; 
Morrow, 1978; O'Donnell, Griffin, & Norris, 1967). Hunt de- 
scribes the T-unit as an independent clause with all of its subordinate 
clauses attached. Thus, it may be equal to either a simple or a com- 




Morrow 

143 



plex sentence. A compound sentence, however, is by definiiion 
made up of two or more T-units. To analyze a story or text retelling 
for T-units, transcribe the child's taped language and divide it into T- 
units. Record the number of T-units and the number of words for 
each. To find the average number of words, divide the total of words 
for all T-units by the total number of T-units. 

For a more specific analysis of syntactic complexity, the Ho- 
tel, Dawkins, and Granowsky (1972) formula (bdg) can be used. 
The formula is based on (1) transformational grammar theory, (2) 
language performance studies indicating the frequency with which 
children at various ages use various grammatical structures, and (3) 
experimental findings that mdicate the relative difficulties children 
have in processing specific syntactic structures. As a tool for lan- 
guage analysis, the bdg formula identifies the elements of syntax 
and assigns each a weight of 0, 1, 2, or 3 to designate its relative 
difficulty. To determine the syntactic complexit> of a language sam- 
ple, count the total weights in each sentence in a group of sentences, 
then average the weights per sentence. 

Appendix C illustrates these techniques of language analysis 
by providing a verbatim transcription of a retelling, its segmentation 
into T-units, and the bdg formula with an application of it. 

Retelling as an Instructional Strategy 

Research on verbal learning indicates that verbal rehearsal 
improves memory and recall for both children and adults (Craik & 
Watkins, 1973; Ornstein & Naus, 1978). In addition to its versatility 
as an assessment tool, retelling (a form of verbal rehearsal) has been 
demonstrated to be a valuable instructional strategy with either 
story or factual r^aterial. 

Numerous benefits have been documented for reading to 
youngsters, then asking them to retell what they have hea. J. Such 
practice helps children develop sophisticated language structures, 
accumulate background information, and develop an interest in 
learning to read (Bower, 1976; Chomsky, 1972; Cohen. 1968; 
Durkin, 1966). Children's participation in literary experiences with 
adult.> aids and enhances their comprehension ability, oral language, 
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and sense of story structure (Blank & Sheldon, 1971 ; Bower, 1976). 
Research results reported by Brown (1975) indicated that children's 
active involvement in reconstructing a stoiy (thinking about events 
in a story, then arranging pictures of the story in sequence) facili- 
tated their comprehension, apparently because in so doing they had 
internalized a representation of the story Pellegrini and Galda 
(1982) foMnd that children's comprehension t)f story and their ability 
to retell stories both improved with active i.ivolvement an J peer in- 
teraction in story reconstruction through role playing. Further indi- 
cations that retelling offers the child a large and active role in 
reconstructing stones and provides valuable interaction between 
teller and listener were reported by Amato and Ziegler (1973). 

Even though it has not been widely tested, there is research 
evidence of retelling's potential in skill development. Further sup- 
port for the notion appears in studies of strategies other than retell- 
ing that share some of its characteristics. For example, Blank and 
Sheldon (1971) measured semantic recall and syntactic complexity 
and found enhancement of both factors in four to six year olds who 
were asked to repeat sentences during a story reading. Zimiles and 
Kuhns (1976) found that retelling a story soon after it was read to 
them not only aided children in comprehension, but facilitated later 
recall. Three studies (Morrow, 1984, 1985, 1986) determined spe- 
cific instructional benefits of story retelling among kindergartners. 
After listening to eight weekly stories and retelling them individu- 
ally to research assistants, students in experimental groups im- 
proved significantly in oral language complexity, comprehension of 
story, sense of story structure, and inclusion of structural elements 
in dictations of original stories. 

In spite of such evidence, children are rarely afforded the op- 
portunity to retell stories in school. A survey of nursery school and 
kindergarten practice (Morrow, 1982) not only documented that 
fact, but found that teachers typically view retelling as time consum- 
ing and too difficult for children. In light of the research evidence of 
its educational value, those attitudes need toh;: reversed. Retelling 
should be encouraged with such supplemental techniques and mate- 
rials as feltboards, role playing, story sharing among classmates, 
and puppets. 
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Because it engages the sludent in holistic comprehension and 
organization of thought, retelling of text acquired information is 
central to the suggestion that retelling enhances comprehension. It 
encourages both integration and personalizati-^n of content, helping 
the student see how parts of the text interrelate and hew they mesh 
with one's own experience. As such, retelling follows a model of 
generative learning (Wittrock, 1981). Holistic in its approach, con- 
cept, and effect, retelling contrasts with the more traditional piece- 
meal approach of teacher posed questions that require students to 
respond with splinters of information recalled from text. 

Research on retelling as a pedagogical tool for improving 
reading comprehension unsurprisingly is sparse, given the apparent 
adverse attitudes of most classroom teachers. Of the research car- 
ried out. Rose, Cundick and Higbee (1984) found that the reading 
comprehension of elementaiy school age learning disabled children 
was increased significantly by verbal rehearsal. The importance of 
that finding is all the more critical since Tarver, Hallahan, and 
Kauffman (1976) and Wong, Wong, and Foth (1977) found that 
reading deficits in learning disabled children are associated wit' de- 
ficiencies in developing mnemonic stiategies. According to a fXudy 
by Torgensen (1977), learning dib'^bled children employ verbal re- 
hearsal strategies less often than Jo normal elementary school 
readers. 

Investigating the effects of retelling on the reading compre- 
hension of fourth grade students, Gambrell, Pfeiffer, and Wilson 
(1985) found superior performance anriong students who engaged in 
retelling over four practice sessions when compared with students in 
the control group, who engaged simply in illustrating texts. Not 
only did their superior performance carry through on both immedi- 
ate and delayed recall, but they correctly answered more literal and 
inferential questions about the test passage than did their counter- 
parts in the control icoup. Results of the study suggest that (1) ver- 
bal rehea;sal impp/'es both comprehension and recall of discourse; 
and (2) through verbal rehearsal, the reader ^listener learns some- 
thing aboit the organization and retention of text information. Ap- 
parently, retelling, both during the processing of textual information 
(Rose,' Cundick, & Higbee, 1984) and following it (Gambrell, 
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Pfeiffer, & Wilson, 1985), helps youngsters to plan, organize, and 
deploy their processing abilities more effectively. 

Summary 

Retelling is valuable for both assessment and instruction, and 
teachers should use it :o assess a child's sense of story structure, 
comprehension, oral language complexity, and reproduction and 
production of stories and text. Analysis of a retelling can help a 
teacher identify problems not obvious when a student is asked sim- 
ply to answer questions (Marshall, 1983). 

Different retelling assessment strategies can be used to mea- 
sure different skills, even though there are strengths and weaknesses 
=n each. Variables such as memory, linguistic frequency, and task 
awareness can confound the results of retelling assessment. Teach- 
ers need to be aware .ch weaknesses and strengths, even as re- 
searchers continue to develop still newer diagnostic measures to 
improvement retelling as an assessment tool (Mitchell, 1984). 

Because retelling has the potential to improve and develop the 
same skills it can assess, it should be used for both purposes. Both 
as an instructional strategy and an assessment tool, retelling helps 
move teachers away from the view that reading is a set of isolated 
skills to a view of reading as a process for conveying and recreating 
meaning. 
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/Appendix A 

Quantitative and Qualitative Procedures 
for Assessing Retelling 



Quantitative: Evaluating Free Recall* 

1 . Divide the passage to be read into units of your own choosing- 
for instance, by phrases or clauses. Mark the end of each unit 
with a slash Be consistent in yonr unit definitions and divisions 
from passage to passage, 

2. On a sheet of paper, list your units in sequence, with empty lines 
to the left and to the right of each unit, forming three columns 
down the sheet. 

3. Assign each unit a number from 1 to 3 and write the number in 
the blank to the left of each unit: 1 for an important unit like a 
main idea, 2 for a moderately important unit, and 3 for an unim- 
portant detail. 

4. Let the student read or listen to the story in its original format, 
then ask the student to retell it, using prompts as necessary. 

5. Record the student's retelling on tape. 

6. Analyze the student's recorded retelling by numbering the units 
on the right hand side of your guidesheet in the sequence in 
which the student has recalled them. Leave a blank by those 
units the student did not recall, 

7. Compare the sequence in which the student has recalled the 
units with their sequence in the original story. 

8. Tabulate the number of units the student recalled. 

9. Note the assigned level of importance of each unit the student 
recalled. 

10. 'u. -quantify the data, divide the number of recalled units at each 
level of importance by the total number of units at that level in 
the original story. The resulting three percentages indicate how 
closely the student's comprehension is biased toward the more 
important units. 

* Adapted from Charles H Clark, Assessing free recall Hie Reading Teacher. 1982. 35, 
434-439 
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Qualitative: The Retelling Profile* 

Directions. Indicate with a checkmark the extent to which the reader's 
retelling includes or provides evidence of the follov^ing information. 

low moderate high 
none degree degree degree 

1. Retelling includes information 
directly stated in text. 

2. Retelling includes information 
inferred directly or indirectly 
from text. 

3. Retelling includes what is im- 
portant to remember from the 
text. 

4. Retelling provides lelevant 
content and concepts. 

5. Retelling indicates reader's at- 
tempt to connect background 

knowledge to text information. 

6. Retelling indicates reader's at- 
tempt to make summary state- 
ments or generalizations based 
on text that can be applied to 
the real world. 

7. Retelling indicates highly indi- 
vidualistic and creative impres- 
sions of or reactions to the text. 
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low moderate high 
none degree degree degree 

8. Retelling indicates the reader's 
affective involvement with the 

text. 

9. Retelling demonstrates appro- 
priate use of language (vocabu- 
lary, sentence structure, 

language conventions) . 

10. Retelling indicates reader's 
ability to organize or compose 

the retelling. 

11. Retelling demonstrates the 
reader's sense of audience or 

purpose. 

12. Retelling indicates the read'^r's 
control of the mechanics of 

speaking or writing. [_ 

Interpretation. Items M indicate - reader's comprehension of tex- 
tual information; items 5-8 indicate metacognitive awareness, strat- 
egy use, and involvement with text; items 9-12 indicate facility with 
language and language development. 



• From PA Irwin and J N Mjlchell Vie reader reielltnfi profile Ustnn reicllm^s to make 
tnstmcuonal densions, in pieparaiion 
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Appendix B 

Sample \nalysis of Retelling 



Parsed Story: Jenny Leams a Lesson 
Setting 

Once upon a time there was girl who liked to play pretend. 
Characters: Jenny (main character), Nicholas, Sam, Mei Su, 
Shags the dog. 

Theme 

Every time Jenny played with her friends, she bossed them and 
insisted they do what she wanted them to. 

Plot Episodes 

First Episode. Jenny decided to pretend to be a queen. She called 
her friends and they came to play. Jenny told them all what to do 
and was bossy. The friends became angry and left. 

Second Episode. Jenny decided to play dancer, with the same 
results as in the first episode. 

Third Episode. Jenny decided to play pirate, again with the same 
results. 

Fourth Episode. Jenny decided to play she was a duchess, again 
with the same results. 

Fifth Episode. Jenny's friends decided not to play with her again 
because she was so bossy. Many days passed and Jenny became 
lonely. She went to her friends and apologized to them for being 
bossy. 

Resolution 

a. The friends all played together, with each person doing what he 
or she wanted to. 

b. They all had a v;onderful day and were so tired they fell asleep. 
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Sample Verbatim Transcription of a Retold Story, Beth, Age 5 

Once upon a time there's a girl named Jenny and she called hci 
friends over and they played queen and went to the palace. They had 
to, they had to do what she said and they didn't like it, so they went 
home and said that was boring. . . . It's not fim playing queen and 
doing what she says you have to. So they didn't play with her for 
seven days and she had. . . she hac an idea that she was being self- 
ish, so she went to find her friends and said, I'm sorry I was so 
mean. And said, let's play pirate, and they played pirate and they 
went onto the ropes. Then they played that she was a fancy lady 
playing house. And they have tea. And they played what they 
wanted and they were happy .... The End. 

Story Retelling Analysis 

Child's name Beth Age 5 



Title of story Jenny Learns a Lesson Date 

General directions: Place a 1 next to each element if the child in- 
cludes it in his or her presentation. Credit gist as well as obvious 
recall, counting boy, girl, or dog, for instance, under characters 
named, as well as Nicholas, Mei Su, or Shags. Credit plurals 
{friends, for instance) as two. 
Sense of Story Structure 
Setting 

a. Begins story with an introduction 1 

b. Names main character 1 

c. Number of other characters named 2 

d. Actual number of other characters 4 

e. Score for other characters (c/d) -5 

f. Includes statement about time or place \ 

Theme 

Refers to main characters primary goal 

or problem to b'* solved 1 
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Plot Episodes 

a. Number of episodes recalled 4 

b. Number of episodes in story 5 

c. Score for plot episodes (a/b) .8 
Resolution 

a. Names problem solution/goal 

attainment 1 

b. Ends story 1 
Sequence 

Retells story in structural order: setting, 
theme, plot episodes, resolution. (Score 
2 for proper, 1 for partial, 0 for no se- 
quence evident 1 

Highest score possible 10 Child's score 8.3 
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Appendix C 

Assessing Language Ability 



Verbatim Tmnscription of a Retelling, Kevin, Age 5 

Once upon a time a rabbit couldn't see. He went to play with his 
friends and he keeped on tripping and he keeped getting lost. He 
went to the doctor and he gave him glasses. Then he can see. When 
he played marbles he hitted a golden, red shiny one and the next day 
he played catch and he didn't even miss. He could help his mother 
go shopping. Now he was happy. He had glasses and could see. 

Story Segmented into T-units 

A T-unit is an independent clause with all of its subordinate 
clauses attached. It may be either simple or complex, but a com- 
pound sentence by definition is made up of two or more T-units. 



T-unit length 



9 
10 
11 
12 
13 



3, 
4 
5 
6 
7 
8 



7 



Once upon a time a rabbit couldn't see. 

He went to play with his friends. 

And he keeped tripping. 

And he keeped getting lost. 

He went to the doctor. 

And he gave him glasses. 

Then he can see. 

When he played marbles he hitted a golden 
red shiny one. 

And the next day he played catch. 

And he didn't even miss. 

He could lelp his mother go shopping now. 

He was happy. 

He had glasses and could see. 



11 
7 
5 
8 
3 
6 



8 
7 
4 
5 
5 
5 
4 



T-unii analysis 



Total number of words 78 



Totai number of T-units 1 3 



Average words per T-unit 6 
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Summary of bdg Syntactic Complexity Count 



O-Count 
Stnictures 



1 -Count 
^iPictures 



2-Count 
Structures 



1 . Sentence patterns 

a. subject-verb 
(adv'^rb) 

b. subject-verb- 
adjective 

c. subject-^^- 
complcment 
(noun, adjective, 
adverb) 

d subject-verb- 
infinitive 

2 Simple transforma- 
tions 

a. mterrogativc 

b. exclamatory 

c. imperative 

3. Coordinate clauses 
joined by and 

4 Nonsentence 
expressions 



1. Sentence patterns 

a. subject-verb- 
indircct object- 
object 

b. subject-verb- 
object-comple 
ment 

2. Noun modifiers 
a adjectives 

b. possessives 

c. quantitative 
determiners 

d. predeterminers 

e. participle 

f. prepositional 
phrase 

3. Other modifiers 
a. advcrbials 

b modals 
c. negatives 
d set expressions 
e. infinitives 

gerund used as 

a suhipct 

4. Coordinaics 
a coordinate 

clause joined by 
but, for, so, or 
yet 

b deletion in the 

coordinate 

clause 
c. paired 

coordinates 



I . Passive 

2 Paired 
conjunction 

3 Dependent 
clause 

4 Comparatives 

5. Participles (not 
used in the adjec- 
tive position) 

6 Infinitives as 
subjects 

7 Appositives 

8 Conjunction 
adverbs 



3-Count 
Structures 



1 . Clause used a« a 
subject 

2. Absolute 



FromM Botel.J Dawkins, andA Granowsk> Syntactic complexity Analyzing it and 
W2^as«n/i^i/. University of Pennsylvania, 1972 
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BDG Worksheet 



Child 



(Kevin) Age (5) Grade (Kdg) Sex (Male) 



T-Lnit and 

Language 

Utterances 



Sentence 
Length 



0-Count 1 -count 
Items Items 



2-Count 
Items 



3 -Count 
Items Total 



Once. ..see 

He ...friends 

And... tripping 
And.x.lost 
He... doctor 
And... glasses 
Then... see 
When... one 

And... catch 

And. . .miss 

He... now 
He... happy 
He... see 



8 



4 
5 
5 
5 
4 
11 



Total Count 13 



SVO 

SVO 

SVO 
SVO^ 
SVO 

SVO 

SVO 
SVO 



SVO 
SVO 



Set ex- 
pression, 
negative 

Prepositional 
phrase 



SVIoO 



3 Adjectives Dependent 
clause 

Adverbial 

begins 

sentence 

Negative 
adverb 

Adverb SVOC 



Deletion 

in suborbinate 

clause 



1 

0 
0 
0 

1 

0 

3 
I 



2 
2 
0 
1 



Average Complexity Count 1 .00 
Average Sentence Length 6 words 
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Using the Microcomputer 
Environment for Reading Diagnosis 



In the late 1970s, reading and language arts educators confronted 
new Information Age technology in the form of microcompu- 
ters. At first, teachers taught students about microcomputers. Now 
they are teaching students how to use microcomputers, and micro- 
computers have begun to play an important role in teaching and di- 
agnosing students. 

While classroom reading teachers, diagnosticians, and read- 
ing specialists have used microcomputers to supplement instruction, 
the role of technology in the diagnosis of reading disability remains 
comparatively new. As we reexamine and rethink diagnosis in this 
chapter, we will examine the pci'^nual and existing capabilities of 
the microcomputer in assisting the diagnostic process. Our goals are 
to explore the role the microcomp Jter can play in a v^'hole language 
diagnostic setting and to explore tlie ultimate (future) potential of the 
microcomputer in the diagnosis of reading and language disability. 
It should be noted that this chapter presupposes a working knowl- 
edge of the microcomputer and of the types of software available for 
reading and language arts classes. 



Diagnosis in the Whole Language Setting 

In a diagnostic setting the microcomputer must be viewed as 
something different from the traditional "tool, tutor, tutee" para- 
digm. As we examine the relationship of students' reading, writing, 
speaking, and listening abilities, it is essential to view the micro- 
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Current role 


Potential role 


in diagnosis 
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in diagnosis 

1 


Drill and practice 


Voice recognition 


1 

Tutorial 


1 

Voice synthesis 


1 

Problem solving/ 


Artilicial intelligence 


adventure 


systems 
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Writing/composing 





computei as a specialized classroom/clinic microenvironment. In 
effect, the microcomputer creates a language environment in which 
the diagnostic process (described in earlier chapters) can take place. 
Students interacting with the mi'^-icomputer create a new setting for 
the exchange of ideas, experiences, feelings, emotions, and con* 
cepts. The interaction of students with a microcomputer provides 
opportunities for conversation, composition, experimentation, 
problem solving, adventure, simulation, and learning. Since the en- 
vironment has become such an integral part of classrooms and clin- 
ics, reading professionals must capitalize on this opportunity for 
observing and recording language behaviors. 

The reading and language related microcomputer envir->n- 
ment allows students to engage in four lanr ige generating activi- 
ties: drill and practice, tutorial, adventure/ simulation and problem 
solving, and composing/writing. Each of these environments pro- 
vides opportunities to diagnose students' language fluency, compos- 
ing abilities, expression of self-concept, view of the world, and 
story sense. Each of these aspects is viewed as an important area of 
concern for reading diagnosis according to the model presented. My 
goal will be to de%e these settings, to offer practical guidelines for 
the observation and recording of language behaviors in these set- 
tings, and to provide instructional suggestions based on the diagno- 
sis of language behaviors in these environments. 
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The Drill and Practice Environment 

Drill and practice software follows the stimulus/reinforce- 
ment model of learning. While not intended to instruct, it is in- 
tended to reinforce and imprint previously taught skills. Its basic 
format is the continuous presentation of exercises (drills), often 
workbook style, »*equiring student input before the next question is 
presented. Student responses are reinforced (positively or nega- 
tively depending on the appropriateness of the answer), and records 
of success and failure kept. The software can be modified by the 
teacher to allow for control of speed, conte'^t, length of lesson, and 
mastery level. The nature of the software requires that one student at 
a time interact with Uie microcomputer; small homogeneous groups 
also might be effective in this setting. 

Since student interaction with the microcomputer's software 
offers insight into reading and language behaviors, reading profes- 
sionals are encouraged to record students' behaviors while using 
drill and practice software. The Observational Checklist for Stu- 
dents Using Drill and Practice Software offers some guidelines. 

Ethnographic Observation. Teachers must be cautious about 
overgeneralizing conclusions about ability or disability in reading 
based on a single observation. Diagnosticians are encouraged to 
continually observe student groupings in different settings before 
drawing conclusions. Observations often lead to further questions 
that, again, must be answered only after repeated, careful observa- 
tion periods. Some practical inteipretation of the observations has 
been Included to assist the diagnostician. Further interpretation with 
additional data is recommended. The use of this and other checklists 
presented in this chapter are intended as only one piece of data in a 
full case study report. 

Observations 1,2,3. Motivated readers have a greater 
chance fo'- success than do nonmotivated readers. Positive rankings 
(scores = 5,4) are one clear indication that reluctance toward read- 
ing likely will not be a cause of disability. Lower scores (0, 1, 2) 
indicate a potential piobleiii with motivation. 

Observation 4. The observation of a positive self-concept to- 
ward the reading process informs the diagnostician that this poten- 
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Observational Checklist for Students Using 
Drill and Practice Software 



Responses 





Observations 


Yes 








No 


1. 


The student demonstrates a desire to find the correci 


5 


4 


3 


2 


1 0 




response. 










1 0 


2. 


The student wi)i fret!y choose to use the software 


5 


4 


3 


2 




again. 










1 0 


3. 


Rewards for correct ans vers assist the student to re- 


5 


4 


3 






spond. 










1 0 


4. 


The student approaches the new software with confi- 


5 


4 


3 


2 




dence and no apparent fears. 










1 0 


5. 


The student can predict a computer generated conse- 


5 


4 


3 


2 




quence to a response. 










1 0 


6. 


The student realizes that selecttid commands cause the 


5 


4 




2 




computer to respond. 










1 0 


7. 


The student becomes more s jccessful with longer use 


5 


4 


3 


2 




of the software. 










1 0 


8. 


The student recognizes repeated language patterns in 


5 


4 


3 


2 




the exercises. 










1 0 


9. 


The student can reproduce the language pattern of the 


5 


4 


3 


2 




computer software exercises. 












10. 


Other observations 













tially damaging roadblock is not contributing to disabilii}. Any 
score below 3 is cause to explore self-concept as a potential etiology 
of disability. 

Observations 5, (5, 7. The student's ability to predict and con- 
trol the software gives the diagnostician baseline data on the stu- 
dent's reading comprehension. Positive observations (scores = 5, 4) 
show that student ma^ery of the content or skill presentation of the 
software is taking place; lower recorded observations indicate the 
opposite. 

Observation 8, 9. Students' ability to recognize and repro- 
duce language patterns is essential and often is prerequisite to effi- 
cient reading behavior. Teachers who can document students' 
understanding of language patterns realize that a lack of language 
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fluency may not accompany the reading disability. Students who are 
unable to recognize repeated language patterns in reading demon- 
strate a lack of readiness for more complex syntactical patterns in 
text. 

Tips on Using Drill and Practice Software 

1 . Drill and practice software is not intended to teach students Use 
it only when you can expect at least a 75 percent success rale. 
Nothing will ruin computer interest, self-concept, and self-con- 
fidence more than a computer exercise that is too difficult for 
the learner. 

2. Drill and practice software can be highly motivational for reluc- 
tant students. Occasionally a^'ow it to replace less attractive 
workbook sessions. A motivated student using the computer 
may read more material at a high level than one exposed only to 
traditional workbooks. 

3. Drill and practice software quickly becomes tiresome and bor- 
ing for students. Allow 15-25 min»::es of use daily. Ideally the 
teacher should observe students hy using the suggested checklist 
in the middle period of use. 

4. If the drill and practice software is modifiable, make sure the 
content, speed, reinforcement, and pace are adjusted for each 
student. Diagnosis us'ig the checklist would yield unreliable 
data if the reading level of the software was not suited to the 
student. 

5. Keep records of student performance on the software to adjust 
future instruction. Continual diagnosis is best. 

6. Coordinate the drill and practice software content with your cur- 
riculum in reading and language arts. Give students opportunity 
for practice in areas covered in recent lessons. 

7. Do not use drill and practice sol ware as a reward or punishment 
for comple'ied/noi.completed, required work. Allow all students 
^nnal j»c ;ess, depending on their needs. 

8. Demonstrate cooperative use of the microcomputer if your re- 
sources are limited. Students can benefit from small group drill 
and practice softwari.*; observe language interaction in these set- 
tings. 

9. Choose drill and practice software that encourages language use 
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and thought; mindless Key pushing will not produce desired 
results. 

10. Select drill and practice software that randomizes practice ses- 
sions for students. Repetitive programs do not benefit the 
learner 

11. Choose drill and practice software with an internal diagnostic 
branch that automatically moves to questions at an appropriate 
level based on user input. 



The Tutorial Environment 

1\itorial software typically follows a Presentation-Practice- 
Apply-Evaluate model of learning. Textual or graphic information is 
presented to the student; the student is given an opportunity to re- 
state the information or complete practice exercises with the new 
data. If the new information is understood, the student applies the 
information in a microcomputer generated activity to imprint the 
knowledge. Tutorials typically conclude .vith an evaluation of ihe 
user's understanding of the concepts presented in a set of straightfor- 
ward questions testing the information. A criterion test score often 
is presented upon completion of the evaluation. 

Sophistica:ed tutorial software often employs leveled 
branches that adjust the difficulty and subsequent teaching based on 
the student's previous answers Co evaluation questions in the soft- 
ware Subject r .er of tutorials is as broad as the field of re?ding 
and language arts, Vocabulaiy, comprehension, study skills, phon- 
ics, grammar, writing, and punctuation have all been adapted to the 
tutorial software format. 

While the nature of the softwaie to pically requires participa- 
tion by only one student, small group work is easily accomplished 
by using the microcomputer as a visual teaching aid for the group. 
The software often keeps records of student performance that can be 
used for continued placement and diagnosis. 

Since student interaction with the microcomputer's tutorial 
software offers insight into reading and language behaviors, reading 
professionals are encouraged lo record the behaviors of students en- 
gaged in learning with tutorial software. The Checklist for Students 
Using Tutorial Software provides guidelines. 

O 
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Checklist fo- Students Using 'Ritorial Software 



Responses 





Observations 


Yes 








No 


I. 


The student demonstrates a desire to learn from the mi- 


5 


4 


3 


2 


1 


0 




crocomputer. 














2. 


The studeni iv,,i;cr.ibers new information* presented in 
the software (short term). 


5 


4 


3 


2 


1 


0 


3. 


The student can remember informrtion for the short 
term, but not for the long term. 


5 


4 


3 


2 


1 


0 


4. 


The student uses aids (notes, returning to the text) to 
assist comprehensi:... 




A 


3 


2 


1 


0 


5. 


The student uses memory/study techniques to assist 
comprehension (sq3r, ReQuest, mn'^monic devices). 




A 


3 


2 


1 


0 


6. 


The student requires the information to be presented 
more than once for understanding. 


5 


4 


3 


2 


] 




7. 


The student continually recycles through the tutorial 
stages of the software (unable to master the cOiicepts), 


5 


4 


3 


2 


1 


0 


8. 


The student becomes frustrated with the ccftware. 


5 


4 


3 


2 


1 


0 


9. 


The student connects new mformation presented in the 
software with past knowledge or experience. 


5 


4 


3 


2 


1 


0 


10. 


Other observations 















Observation 1. Motivated readers have a greater chance for 
success than do reluctant readers. Reluctance to use the reading soft- 
ware should not be confused with disability. 

Observations 2, i, 4, 5. The method students use to remem- 
ber information can be observed and evaluated when students inter- 
act with tutorial software. Unobtrusive observation will indicate 
memory techniques the student uses. Special notes on how the stu- 
dent studies or remembers will serve the diagnostic process. 

Observations 6, 7, 8. Metacognitive strategies can be ob- 
served by using these guidelines. If the student consistently elects to 
stop, regress, and reread information, teachers will realize that 
comprehension monitoring is not simultaneous with the reading act 
(as it should be). Students who consistently recycle through infor- 
mation for comprehension should be identified for renediation in 
this area. A high positive (scores = 4, 5) observation for question 8 
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should be scrutinized. A high score is clear indication that ti. < read- 
ing level of the tutorial is beyond the student's capabilities. 

Observavon 9. A student's ability to connect new information 
with old indicates sophisticated reading behavior. Lack of adequate 
background should be made known to the diagnostician early in the 
attempted reading. Identifying a lack of background information as 
the etiology of comprehension disability is a precise diagnosis that 
should not be confounded with more recognizable reading compre- 
hension deficiencies. 

Tips on Using Tutorial Software 

1 . Do not use tutorial software to replace introductory teaching of a 
new concept. Make sure students have some background in the 
topic before they use software. 

2. Tutorial software should be on the student's independent reading 
level to ensure focus on content rather than on the reading proc- 
ess. 

3. Tutorial software should automatically branch to easier material 
when the student enters two or three wrong answers. Avoid frus- 
tration. 

4. Tutorial software should usepeiiodic, randomized reinforcement 
incentives for students. There is no need to shoot stars and ring 
bells for every correct response. 

5. Tutorial software should set realistic mastery goals for the student 
and consistently report learning progress throughout the work 
session. 

6. Content of tutorial software should be coordinated with your cur- 
riculum in reading and language arts. Students should be given 
an opportunity for independent work in areas covered in recent 
lessons. 

7. Do not use tutorial software as a reward or punishment for com- 
pleted/noncompleted, required work. It might effectively be used 
for make up or independent work. Allow all students equal ac- 
cess, depending on their needs. 

8. Demonstrate cooperative use of the microcomputer if your re- 
sources are limited. Students can benefit from small group tuto- 
rial software; observe language interaction in these settings. 
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9. Choose tutorial software that encourages language use, notetak- 
ing, writing, or discussion away from the computer. Encourage 
students to discuss their experiences in other classroom settings. 

The Problem Solving/Adventure Environment 

Problem solving and adventure software use more of the ca- 
pabilities of the microcomputer than any other type of instructional 
software. This software includes simulation, gaming, problem solv- 
ing, interactive fiction, adventure, and creative art types of pro- 
grairs. 

As its name implies, problem solving software asks students 
to solve a problem in logical thinking. The varit;ty of software in- 
cludes mystery stories, brain teaser puzzles, deductive reasoning 
problems, and simulations. A dominant genre in this area of micro- 
computer software is the interactive fiction story, where the student 
rea r becomes a character in the story with the ability to control 
the plot. 

Essential elements in the problem solving software are based 
on probabilistic and deterministic models. Programs based on prob- 
abilistic models randomly chcMenge the user to overcome difficulty, 
solve a dilemma, or complete a task. Those based on the determinis- 
tic model base all computer responses to the user on the previous 
problem solving decisions and input by the user (i.e., no random or 
chance occurrences). The more deterministic the model, the more 
closely the problem solving behavior approaches thr type of think- 
ing involved in real life. 

Creative art programs simply use the microcomputer as an 
artistic medium. Divergent thinking is encouraged, and the student 
uses the microcomputer to diagram ideas, paint scenes, create de- 
signs, or produce animated pictures on the screen. Most programs 
allow the use of color, permit the saving of art work, and the modifi- 
cation of an on disk library. Art created with these software pack- 
ages often acts a*- precursor to writing or is later added to student's 
writing composition. 

Since student interaction with the microcomputer's problem 
solving/adventure software offers insight into reading and language 
behaviors, readin? Professionals are encouraged to record the be- 
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Observational Chjckltst for Students Using 
ProbJcm SoIvL^",/ ^-dventure Software 



Re^sponses 

Observations Yes No 



1. The student continues to use a problem solving sirat- 5 4 3 2 10 

egy that has been successful in the past. 

2. The student attempts to manipulate the problem/adven- 5 4 3 2 10 

ture story to his/her advantage. 

3. The student attempts to organize the information pre- 5 4 3 2 10 
sented in the problem for later recall. 

4. The student can predict solutions to the problem based 5 4 3 2 10 
on information in the software. 

5. The student can relate relevant personal background 5 4 3 2 1 0 
experiences to the software. 

6. The student can follow the directions/hints given by 5 4 3 2 10 
the software. 

7. The student realizes that a complex problem can be di- 5 4 3 2 1 0 
vided into subparts. 

8. The student i calizes that subparts can be put together 5 4 3 2 10 
to form a whole. 

9. The student realizes that there is a beginning, middle. 5 4 3 2 1 0 
and end to the problem (story sense). 

10. Other observations 



haviors of students learning with this software. Examine the Obser- 
vational Checklist for Students Using Problem Solving/ Adventure 
Software for guidelines. 

Observations 1,2. A student's ability to capitalize on and re- 
peat successful behavior is essential for reading. If a student can 
solve a problem and repeat that problem solving behavior, the 
chance is minimized that initial success was random. Establishing 
c >trol over an environment develops the self-confidence requisite 
to successful reading. Students who achieve success by chance, not 
by plan, will feel no control over text in reading. 

Observations 3, 4. Organization and prediction abilities are 
requisite for reading comprehension. Observing a successful orga- 
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nizer will give the diagnostician background information vital for 
correct diagnosis. Knowing that a student can predict offers insight 
into a student's comprehension abilities. Positive observational 
rankings in these two areas (scOi-es = 4, 5) indicate the student is 
using appropriate metacognitive strategies that will lead to compre- 
hension. 

Observation 5. If the student has relevant background experi- 
ences in the topic, the potential is enhanced for text comprehension.. 
Students realizing similarities between reading and previous experi- 
ences are in an advantageous position. 

Observation 6. Comprehending directions in software pro- 
grams is essential for success. Diagnosticians obserxing students 
completing software without outside help can be assured students 
have some ability to read for following directions. Negative rank- 
ings on the observations in this area (scores = 2, 1,0) indicate the 
software is above the reading level of the student user. 

Observations 7, S, 9. Students with sophisticated cognitive 
schemata will realize that most often the whole is the sum of the 
parts. They will perceive sequence and summation in a problem or a 
story. Deficient abilities in these areas would cause grave concern to 
the diagnostician observing a student in the microcomputer environ- 
ment. Students lacking in conce nual, organizational, or story sense 
abiliti( . will suffer sevevcly in reading comprehension related 
activities. 

Tips on Using Problem Solving/Adventure Software 

1. Problem solving/adventure software is used most successfully in 
small groups. Since students will be using language and verbaliz- 
ing problem solving strategies, the verbal and thinking interac- 
tion between students and microcomputer is best observed when 
two to four students use the software in a group. 

2. Integrating problem solving software into the curriculum is a par- 
ticular challenge. A match is needed between the type of thinking 
required at a p^-^icular stage in the curriculum and the type of 
thinking taught in the software. The focus in the match should be 
on the thinking required. 

3. Adventure software suppleni^iits the literature curriculum. While 
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not typically classified as reading software, this literature is as 
close a parallel to traditional book reading as the computer can 
provide. Adventure software should be used in the language arts 
program in the same manner as books are used in the classroom. 

4. Problem solving >^ftware is not an end in itself. The skills and 
abilities reinfr.ced or learned in this experience must be transfer- 
red by the student (with the aid of the teacher) to the language 
arts area of the curriculum. Once a problem has been solved us- 
ing a particular line of reasoning the teacher must provide an 
example of using the skill in the subject being taught. 

5 Demonstrate cooperative use of the microcomputer if your re- 
sources are limited. Students can benefit from small group prob- 
lem solving, interactive fiction, and adventure software. Observe 
language interaction in these settings. 

6. Choose software that encourages language use, notetaking, writ- 
ing, and discussion away from the computer. Encourage students 
to discuss their solutions to problems, experiences with adven- 
tures or simulations with peers in other classroom settings. 

7. Encourage the use of the creative art software in conjunction with 
your creative writing program. Computer generated graphics add 
prestige and expertise to student work and often serve as p^swrit- 
ing stimuli. 

8. Gaming software is easily modifiable to include concepts from 
the language arts curriculum. Since playing a game to reach a 
goal (or be the win.xr) involves strategies similar to problem 
solving, encourage cooperation in the use of this ty; e of software. 

Diagnosis in the Writing/Composing Environment 

Word processing software and computer assisted writing pro- 
grams are two types of programs students typically use in ine com- 
posing process. Educators agree that word and tea processing are 
the most commonly used types of software in elementary and sec- 
ondary schools. 

In effect, word processing programs turn the microcomputer 
into an electronic typewriter allowing on screen correction of er- 
rors, multiple editing tasks, and disk storage of writing. Word proc- 
essing programs are available at all levels of sophistication. Some 
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programs allow complex margin setting, italiciz'^d wiiting, boldface 
printing, file merging, and page numbering; more simplified ver- 
sions allow large screen printing, editing, and simple text moving 
procedures. Word processing software is logically viewed as a tool 
in the vvriting process 

Computer assisted writing, on the other hand, actually aids in 
the writing process. This type of software might assist students in 
any step of writing from the prewriting and drafting stages through 
revising, editing, and publishing the composition. There is software 
in this category designed to enhance the prewriting stages of the 
composition process by leading students through the brainstorming 
and preorganizational steps of writing. There are templates or writ- 
ing frames that allow students to fill in existing paragraph outlines 
with personalized informatioii (i.e., the cloze procedure for creative 
writing) that assists s'ludents in revising their writing Spelling and 
grammar checkers are designed to assist students in the e . ting and 
publication steps of writing by highlighting misspelled words, unac- 
ceptable punctuation, or incorrect grammatical formations. Para- 
graph, poetry, book report, and essay "frames" require students to 
insert key words to create the entire composition. Disk storage sys- 
tems are available to save early drafts, count words, and calculate 
average sentence length. While all of these forms of assistance are 
potential aids in the writing process, teachers should note that abuse 
or overusf of the aids will not produce independent writers. The 
Observation Checklist for Students Using Writing/Composing Soft- 
ware provides some guidelines. 

Observations /, 2. The microcomputer environment is usu- 
ally a motivating factor in the writing and revising process. The 
promise of using the microcomputer for composing often will moti- 
vate even the most reluctant of writers. Students with poor hand- 
writing or self-expression skills often find the word piv.. .^^or to be 
the great equalizer. Since students typically spend more time com- 
posing and sharing when a microcomputer is available, diagnosti- 
cians should be aware of ..le power of the technology to influence 
both composing ability and time on task. Positive rankings in these 
observations (scores = 5, 4) woUid indicate the powerful effect of 
the microcomputer on the composmg process. 
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Observation Checklist for Students Using 
Writing/Composing Software 

Responses 

Observations Yes No 



1 . The student has willingly chosen to write. 5 4 3 2 1 0 

2. The student takes pride in the finished product. 5 4 3 2 1 0 

3. Th<* student has organized thoughts before approach- 5 4 3 2 1 0 
ing the microcomputer to write. 

4. The student composes from notes or prepared outlines. 5 4 3 2 1 0 

5. Th Uudent, when asked, can write based on personal 5 4 3 2 1 0 
experiences. 

6. The student's writmg reflects some perception of how 5 4 3 2 1 0 
the student views reality. 

7. The student*s writing reflects language n,,aerns en- 5 4 3 2 1 0 
countered in reading and speaking. 

8. The student uses editing and revision techniques to en- 5 4 3 2 1 0 
hance writing. 

9. The student uses varied sentence structure and length 5 4 3 2 1 0 
in the composition. 

10. Other observations 



Observations 3, 4. Observing a student's preparedness to 
write is essential in the diagnosis of writing behavior. Students who 
begin the writing process at the drafting stage, ignoring the prewrit- 
ing step, are clearly doomed to inadequate composition. Diagnosti- 
cians can easily identify a student who comes to the drafting stage, 
at the microcomputer, with writer's block; the student will have no 
notes, outline, or prepared ideas. Diagnosticians also have the op- 
portunity to record and interpret student^ prewriting rituals that 
may lead to success or failure in the composing process. 

Ohservations 5, 6. Students' writing is most successful when 
based on personal experience and per )nal perceptions of the world. 
As the student is writing, the teacher can monitor the progression of 
words on the screen. (Standing behind students using o mputers al- 
lows the diagnostician to watch several writers at once.) The observ- 
ing diagnostician has the opportunity to encourage the reluctant, 
suggest word revisions to the editors and provide in text sugges- 
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tions to those revising. This participatory observation also can be 
done with sti 'ents in small group settings. While diagnostic obser- 
vation in this o^.ting is b:jnr%ial, leading questions geared to indi- 
vidual students provide inst. iciion in writing ability as the student 
composes. 

Observation 7. Beginning writing style often reflects fSe :yle 
of an author previously read by Uip students. A student who begins 
the writing process by imitating the style of another author demon- 
strates a sophisticated understanding of the patterning of text. Diag- 
nosticians should capitalize on this ability by encouraging students 
to go beyond the imitated style to develop their own writing and lan- 
guage patterns. 

Observations S, 9. U.vhers observing the writing behaviors 
of students must know if the current work is a first draft, a revision, 
or a final copy for publication. Student writing must be judged us- 
ing different criteria in varying stages of development. Students who 
do not revise their writing, change text, or rework sentences are typ- 
ically not as successful in the writing process as those who do. The 
microcomputer environment allows the diagnostician another op- 
portunity to observe students of various stages of writing. Using ob- 
servations similar to items 8 and 9 will pre /ide deeper inf ight into 
the mental processes of students engaged in writing. 

Tips on Using Writing /Composing Software 

1 . Adequate time must be provided for keyboarding/word process- 
ing instruction. While typing 8-12 words per minute is adequate 
for elementary composing, a period of time (20 minutes, 3 times 
per week) in the language arts curriculum must be committed to 
the task. Teaching writing must be integrated with instruction in 
the use of word processing. 

2. Students should become familiar with word processing in small 
group, language experience activities directed by the teacher. A 
teacher, aide, or experienced student should be employed to as- 
sist inexperienced typists. 

3. The keyboard should not replace the pen and pencil as composing 
if uments. Prewriting and organizing using conventional writ- 
ing approaches can be done before arriving at the computer. 
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4. Teachers must reach a delicate balance between interfering in the 
writing process as they observe students compose and assisting 
the writing process ( , eratively. Teachers should nevei take 
over the keyboard to control the writing of a student. 

5. If possible, students who are prepared should be given open ac- 
cess to the microcomputer to begin the composing process. Pre- 
writing and organization take varied amounts nf time depending 
on the students. Using the word processor before the writer is 
ready will nut produce the desired results. 

6. Teach students the replace command of the wr pnxessing soft- 
ware early in the microcomputer training. Tl.j versatility and re- 
vision capabilities of this command will prove lo be among the 
most satisfying for the student. 

7. Demonstrate cooperative use of the microcomputer if your re- 
sources a»-e limited. Students can benefit from small group writ- 
ing and composing activities. The use of the language experience 
approach with small groups is an ideal use of the word processing 
software. Observe language interaction in these settings. 

8. Encourage the use of the creative art software in conjunction with 
the creative writing program. Selected word processing software 
incorporates drawing or graphics programs. Story book creation 
programs exist to initiate the building of student authored li- 
braries on disk. 

9. Consistent use of the word processing software will ensure the 
continuous development of student expertise with the microcom- 
puter. Alternative input devices (touch screens, modified key- 
boards) are available fo. handicapped students. 

Potential Role of the Microcomputer in Reading Diagnosis 

Using the microcomputer as a tool for the diagnosis of read- 
ing and language behaviors of students remains in its developmental 
stages. Software that purports to write a prescription basei on a 
computer generated diagnostic reading lest taken by the studen^ is at 
best weak and overgeneralized and at worst misleading and inaccu- 
rate. There is, however, great potential for more fully developed 
software of this lype to play a significant role in the diagnosis of 
reading and language behaviors in the 1990s. 
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The potential use of the microcomputer as a diagnostic tool (a 
role quite different from the microcomputer environment described 
to this point in the chapter) is dependent on the continued develop- 
ment of two areas of microcomputer technology: voice recognition/ 
voice synthesis and artificial intelligence. In short, for the 
microcomputer to be an effective tool for the diagnostician it must 
be able to listen to and speak to the reader via natural language 
transmissions, and it must be able to evaluate language behaviors 
and relevant testing data with the expertise of an appropriately 
trained reading professional. 

Voice Recognition 

Voice recognition is the ability of the microcompr*ir to un- 
derstand the verbal input of the user. The limited capabilities of the 
microcomputer allow the speaker/user to use a limited vocabulary 
(up to 1 ,000 words with selected software) to interact with the mi- 
crocomputer. Capabilities of the microcomputer to recognize voices 
require a "voice print"" of each user. The procedure requires up to 
thirty minutes of interaction with the software before true use be- 
gins. Current voice recognition technology is reported as only 95 
percent accurate, even after the voice orint has been established. It 
is clear that a 5 percent error rate in listening to a reader's output is 
unacceptable for accurate reading/language diagnosis. 

Voice Synthesis 

Wice synthesis is the ability of the microcomputer to repro- 
duce human sounding speech. Current technology has almost elimi- 
nated robotic, mechanical sounding speech, but it is far from a 
multitoni) and inflectionahy accurate reproduction of speech. 
Again, while some software is capable of reproducing up to 5,000 
words, it is far from the accurate interactive speech necessary for 
reading or language diagnosis. 

Artificial Intelligence Systems 

Artificial intelligence systems (dubbed expert systems) appear 
as more sophisticated possibilities for the diagnosis of reading and 
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language related behaviors. Expert systems are intelligent programs 
that output prescriptions based on data introduced by the user or 
specialist. Expert systems in use by the medicai profession are able 
to diagnose selected diseases with up to 75 percent accuracy, when 
compared with the diagnosis of a trained physician. Comparable 
systems for the diagnosis of reading and language behaviors do not 
yet exist. The potential is excellent for an expert system to diagnose 
reading behaviors. 

There are many problems associated with expert systems in 
the area of reading diagnosis. Expert systems are based on profes- 
sionally agreeo upon definitions and an accepted model of behavior 
or performance easily described and capable of precise delineation 
(e.g., symptoms of a medical disease). Herein lies the problem. 
When dealing with the cognitive and affective domains, precision is 
difficult to achieve. Furthermore, whose model of reading instruc- 
tion would be employed by the expert systems? Would it be a sub- 
skills approach? A whole language model? A pure psycholinguistic 
approach? A combination? If an expert system diagnosed a vocabu- 
lary problem, would it recommend instruction in phonics, phrase 
reading, morphology, spelling, wide reading, or context clues? 
Would it be programed to diagnose specific phonological, <^emantic, 
or syntactic problems? Would comprehension instruction have pri- 
ority over word recognition instruction? Is it possible to develop an 
expert system on a topic where there is substantial professional dis- 
agreement? The answers remain unknown, as does the fM^ure appli- 
cability of any expert system developed by a team of artificial 
intelligence experts, completer scientists, and reading professionals. 

The potential is bright for using the microcomputer as a diag- 
nostic tool, but there are significant problems. Reading profession- 
als are cautioned to examine closely any software that claims 
diagnostic capabilities. The underlying concern that the software 
defines reading and language behavior in a way that is philosophi- 
cally compatible to the users definition is of vital importance. Con- 
comitant concerns of how the program makes decisions, what 
alternative prescriptions are within its capabilities, and its ability to 
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discriminate reading difficulties should be of highest concern to all 
reading professionals. 

Summary 

The microcomputer e ironment is an information laden set- 
ting to be explored by the reading teacher/diagnostician. Observa- 
tions of students interacting with th^ dynamic print of 
microcomputer software can add valuable information to the total 
diagnosis of reading and language ability. This information -used in 
conjunction with information gathered in other settings, at other 
times, and under other conditions-will add significant diagnostic 
insight to a case report conducted by a reading professional. 
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Physical Arrangements, Grouping, 
and Ethnographic Notetaking 



This chapter describes a classroom organized so that a teacher, 
reading specialist, or anyone involved in the diagnosis of a stu- 
der,t*s reading or learning problems wih oe able to observe the stu- 
dent effectively. This observer will use a structured, systematic 
method of note taking and record keeping to provide ongoing and 
constantly corrected diagnostic and prescriptive decisions about the 
student^s performance. 

Settings 

How can school environments be arranged to provide teach- 
ers, diagnosticians, planners, and evaluators with opportunities to 
observe children's reading and other language abilities? School en- 
vironments that best provide diagnootic information about children 
include the classroom (and specific areas in it), playground, lunch- 
room, gym, music room, art room, and even the school bus. Ob- 
servers of children's language behavior-reading, speaking, 
listening, and hearing -can use any of the above environments to 
collect data about an individual, a small group, or a classroom of 
children. 

Usually teachers/specialists who are engaged in diagnostic 
evaluation (as well as the planning that should follow such evalua- 
tion) have information a ailable to them This material is often the 
result of previous testing in a school office. This data may be called 
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the medical model material. It provides test scores and descriptions 
that usually were gathered during testing sessions with a specialist 
on the school staff. While this information is useful, teachers need 
to add to it by observing children. This chapter will help teachers 
use an information gathering system in a classroom to augment, 
supplement, and improve the information provided by the medical 
model. The c-a-l-m approach by Glazer and Searfoss, described in 
detail earlier in this monograph, is partly the basis for the material 
in this chapter. 

An ideal setting for this diagnosis is a flexible classroom 
where desks can be moved, chairs of varying sizes are available, 
and the furniture is sturdy (Muffett & Wagner, 1976). There are 
fixed areas in ♦he classroom, such as a library corner that has a rug 
and some seating pillows. This area has many books on numerous 
subjects and at varying levels of difficulty. There also is an art sec- 
tion in the classroom stocked with paper, paints, and crayons. An 
area is available where computers and their software are housed. In 
addition, there are cabinets for tape recorders and videocussettes. 
Teacher created learning centers are locared around the room. There 
is nothing new about this kind of classroom; it is the ider set up 
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(Sawada, 1986). What is new is the opportunity this setting provides 
for gathering and recording informauon to diagnose children's read- 
ing abilities and refine educational prescriptions for them. 



Ethnographic Procedures 

This system of recording observed behavior.-: is called eth- 
nography. It is defined by Taylor (1982) as a "disciplined way of 
looking, asking, recording, reflecting, comparing, and reporting." 
Anthropologists have used it for many years but only recently have 
educators turned their attention to it (Pfearson, 1984). Carini (1975) 
provides an in depth analysis of theory as well as a psychological 
description of interactions between the observer and the observed 
when observation and description of behavior are combined to pro- 
duce ethnographic recordings. 

Several studies have exemplified the use of ethnographic pro- 
cedures as a way to record behavior One such investigation (Bussis et 
al., 1986) provided research data on beginning reading. Twenty-six 
children w, :e studied for two years (kindergarten through first grade) 
as the authors investigated and documented beginning reading proc- 
esses and learning styles. Another ctudy concentrated on the educa- 
tion of binational migrant children as they moved between Mexico 
and California (Mounts, lv66). A study conducted to examine differ- 
ences in oral and written discourse in early grades (Slaughter et al., 
1985) also describes a coding system foi analysis of protocol data. 
Such examples suggest that educational research is widening its scope 
and using tools such as ethnography to diagnose, to refine diagnoses, 
and to prescribe appropriate educauonal programs for students. 

Data Collection 

For the purpose of this chapter, ethnography may be defined 
as a system of laking repeated and detailed notes about a subject or 
subjects in a single environment, for a specified time. Generations 
or well trained teachers have made detailed observations by t,.dng 
informal notes. The reader is justified in asking, "So what's new?" 
The newness of the process concerns the last step: creating a hy- 
pothesis fa ... the data collected. This fits the c-a-l-m approach with 
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its insistence that data constantly be refined and new hypotheses cre- 
ated. 

Ethnographic data may be collected by taking detailed, spe- 
cific, and continuous notes for a specific time. These :iotes may be 
supplemented by using a videocamera to record behavior, or a tape 
recorder for voices. These devices tend to be intrusive and should be 
in place for several days before the actual data collecting begins so 
the subjects will not "play to the camera." 

As the data accumulate, the observer should analyze the ma- 
terial and create new and reCned hypotheses to narrow the focus of 
the dat collecting. In other wordi^v the researcher generates inter- 
pretations and "fine grained analyses" (Taylor, i982). These inter- 
pretations produce new hypotheses. The data comction continues 
an^' the hypotheses aie cons*uintly changed as the observer gains 
new insights. As an analogy, the medical model is a photograph that 
freezes a person's behavior and accomplishments in time. The eth- 
nographic or c-A-L-M approach may be compared to videotaping a 
persons' behavior and achievements over time. 

Stages of Ethnographic Processes 

Ethnographic approaches to reading research arc in 'estigatc^d 
in detail jy Guthrie and Hall (1984). They use Spindler's w^fk 
(1982), which sets forth three stages of the ethnographic process. 
The first is reconnaissance, in which the ethnographer becomes fa- 
miliar with the setting. 

Second is the reconnoiter stage, where the observer begins to 
delineate the broader aspects of the investigation and examines gen- 
eral aspects of the eiivironnicnt. Analyses of behaviors are made as 
the data are collected. Then the first hypotheses are formed, tested, 
and accepted or refined, so data collecting may begin anew with a 
different focus. As is evident from these descriptions, ethnographic 
recordings tend to be cyclical. 

The final stage is termed microethnography. in this phase, 
small pieces of human behavior are examined in detail. The teacher 
or researcher has some general knowledge of the student fr*- n pre- 
vious ethnographic research and now takes one relevant aspect of 
behavior (e.g., reading silently during uninterrupted silent reading 
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period; and makes detailed notes during the specific activity and 
period of time. This final st?z^ refinwS the process so it is of use to 
teachers and researchers. At this stage, it may be possible to synthe- 
size many observations and notes. The creation of useful, specific 
hypotheses will help form a useful teaching strategy. 

Tools of Ethnographers 

Ethnographers are either nonparticipating observers or par- 
ticipating observers as teachers would be (Sprac'ley, 1980). In their 
participant observational siudies, Walker and Adelman (1976) note 
that shared information must be understood in a context of long term 
shared meanings. Such information may be delivered by student or 
teacher by as little as a single pnrase or key ^vord. This stimulus 
word, which participants recognize from a previous experience, col- 
ors the present situation. It is important that observers be aware of 
classroom interactions so they may understand the observable be- 
havior as well as the hidden messages being passed. Observers must 
remain objective and record all behavior of the subject(s) during the 
time chosen for the study. 

Researchers may use one or all of several interviewing tech- 
niques (Spradley, 1979). They may use tne structured interview to 
elicit information from people who interact with the child being 
studied, including parents, teacl ers, and after school daycare staff. 
Semistruc^ured interviews also may be used., In these, the re- 
searcher has a set of questions to ask, b:it is willing to discard them 
if a promising lead is provided by the interviewee. 

The researcher may also use a key informant. This person is 
interviewed to provide information about the subject, but the re- 
searcher also "discusses the research and checks out the hypotheses 
and hm( hes with him or her" (Pearson, 198^'). 

Journal entries and diaries may be c*" g^eat use in ethno- 
graphic research. When children keep daily dianes, their entries 
may reveal how they feel about events in their lives and about their 
achievements in the classroom. It is important for those studying 
students to understand the children's beliefs, their feelings, and how 
they react to their failures and su':cesses. 



^ .iiysical Anangements, Grouping, and Notetaking 173 

& 182 



Sample Procedure Using Setting and 
Fthnographic Procedures 

The teacher who has organized the ideal classroom described 
in the beginning of this article probably also has a class in which 
lecturing or "talking at" students is kept to a minimum. This teacher 
will have lesson plans and contracts for the children to encourage 
them to work independently and in self-directed groups. During 
these activities, the teacher (diagnostician, specialist) will establish 
a time for observation and taking notes on one child. A teacher who 
wishes to study a reluctant reader during Uninterrupted Sustained 
Silent Reading (ussr) might decide to begin an ethnc^ phic record 
of this child's activities. 

1:00 p.m. USSR— John removed book from desk- coked at 
cover-glanced at Fred-shifted in seat- leaned forward and 
whispered to Fred -(no reply) -settled back, opened book- 
turned pages-subvocalized as he read first page. . . . 
1:06 J poked Fred-F 'urned and frowned- J looked at 
teacher-opened book and again started to read. . . . 

The teacher might take notes during the ussr period for several 
weeks or for only two or three days. At the end of a period, the 
notes might be analyzed: 

Analysis. John is not able to concentrate on his book during 

USSR. 

John would like to socialize w'*h Fred. 
Then these hypotheses might be created. 

1 . John does not like to read silently in the book he has se- 
lected. 

2. John is unable to read and comprehend the book he has 
selected. 

3. John has strong needs to s Kialize. 

4. John has a dependent relationship with Fred. 

The teacher may test one of these hypotheses by taking notes about 
John in a classroom situation that will give more infoimation. The 
first hypothesis may be examined by looking at records of John's 
reading scorer (the medical model test results). His abilities may be 
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di ;cussed wir^h a teacher who taught him the previous year or with 
the reading specialist who has known John since he began school. 
Either of these people might function as key informant for the stud- 
ies. Informal reading tests might be given to John (Potter & Rae, 
1973) to ascertain the level at which he reads. Or John might be 
instructed in the "fistful of words rule" (Glazer, 1980) so he will 
choose a book more appropriate to his reading level. There will be 
continued observation of how John acts in ussr. 

In order to test the second hypothesis, the teacher could ask 
John to retell the story he has read (Morrow, 1986). The teacher 
r *ght have John tape record his retelling so an analysis could be 
made of it. This will help to assess whether John has read and com- 
prehended his book. 

The teacher may choose to test the third and fourth hypothe- 
ses by taking notes about John when he is at recess or in the lunch- 
room, in order lo have data that will help understand John's need to 
interact with other students. The teac.-er can observe him in situa- 
tions where socializing is appropriate to see if John plays only with 
Fred, or if he plays with other children. Then reassessment can be 
made of his behavior in ussr and other silent reading sessions with 
more information available. 

After ef (ablishing this new set of data, the teacher may decide 
to focus on John's behavior in other environments where he reads 
silently, such as a Directed Reading Activity. Does the additional 
data collected match that collected during ussr? What analysis and 
hypothesis does this set of notes provide? What other environment 
may be checked to verify or dispro^ the theories generated? 

It should be apparent from ihe about discussion (which is 
greatly oversimplified for the sake of brevity) that John's teacher has 
a structured method of collecting data about him in an environment 
that makes such collecting possible. There is direct, sequential evi- 
dence provided by observations of John's oehavior during this one 
time period. Other sources to supplement this information may be 
used: teacher observations of John during the school uay ; and John's 
school records, school tests, anu reports of school personnel rang- 
ing from the playground aide to the principal. This infom.ation will 
give a more complete picture of the subject. The canvas v ill never 
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be a finished product but, rather, one that is changed and made 
more faithful to its subject. Thus, the picture of John will change as 
environments change, and diagnosis and remediation will probably 
become more accurate. 

The perceptive teacher may also use John's journal entries to 
gather information about his feelings toward reading in any form. 
When this writing/reading activity is used, pupils are told that only 
the teacher will read their journals. The teacher responds to what 
students write every day, but does not correct grammar, punctua- 
tion, or handwriting. Teacher responses to pupils' entries should be 
as positive as possible. As students learn to trust the teacher, a 
wealth of material may be collected about students' feelings and atti- 
tudes. Such knowledge must be kept confidential in order to have 
the children continue to trust the teacher. However, tl.js material will 
also help diagnose John's attitudes and ideas about reading. 

The teacher is able to use this system of ethnographic record- 
ing because the classroom setting encourages children to act inde- 
pendently; it is child centered (Moffett & Wagner, 1976) and uses 
the student's self-motivation to provide an impetus for learning. 
While children move about in a classroom that has a strict, underly- 
ing structure, but which allows them appropriate freedom, the 
teacher may have periods of time to make notes on the student being 
diagnosed. 

Obviously, teachers will not take ethnographic notes on each 
student. They will choose the one who is a puzzle, or who is unmo- 
tivated, or one for whom ordinary strategies do not work. Then, by 
this intense system, they may be able to diagnose and prescribe to 
the benefit of the student. They will have a powerful set of tools to 
help them become the excellent teachers they wish to be. 

Sumnary 

This extended method of diagnosis may be called the educa- 
tional model of diagnosis; it retains the medical model, and it is im- 
plemented by the Glazer-Seaifoss c-a-l-m approach. It takes place 
in a classroon: t' -^t can be changed and reorganized easily; it insists 
on structured, detailed, specific observations for a limited time arJ 
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in a specific environment. It is never ending. It is constantly revised. 
It is open ended. No one specialist, diagnostician, teacher, or evalu- 
ator presumes to know everything about a stu'*:nt. (See Abrams, 
this volume.) Those who work with students revise their evaluations 
periodically and prescribe educational strategies and techniques for 
them. As students mature, the diagnosis must change, and as the 
diagnosis ch anges, new strategies must be suggested. In the begin- 
ning of thi^« chapter, the me 'ical model was described as a snapsphot 
of a child- a picture frozen in time. The educational model provides 
pictures of children in many activities as they change and mature. 
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Afterword 



The idea, and suggestions in this mono^^i-aph not onI> help 
classroom teachers reexamine issues related to reading diag- 
nosis but provide a rich and broader perspective of students' reading. 
The text is a valuable resource that aids teachers \n their quest to 
identify students' reading strengths and weaknesses. The work is 
meant to encourage teachers to expand their view of reading mea- 
surement, to go beyond standardized test results in order to provide 
students with ongoing, meaningful assessment and instruction. 

Historically, the use of standardized tests to evaluate reading 
performance has helped classify students in respect to word recogni- 
tion, vocabulary, comprehension, and ^-^te. Ho* ever, many of these 
tests do not properly reflect the educational aims being sought. The 
focus on individual differences within or among groups in reading is 
limiting. It furnishes data for those interested in making broad com- 
parisons of classrooms, schools, or school districts but provides lit- 
tle information to help teachers develop students' reading strengths 
and design instruction to advance their learning. 

The trends of a rapidly changing American society require 
schools and teachers to broaden diagnosis and instruction in reading 
to meet the needs of multicultural students and socioeconomically 
diverse groups. We feel this monograph affords professionals at all 
levels innovative diagnostic tools and procedures necessary to help 
students adjust to reading and learning in today's classrooms. 
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